Apr 12 01:45:33 user nova-compute[82184]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 12 01:45:36 user nova-compute[82184]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=82184) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 01:45:36 user nova-compute[82184]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=82184) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 01:45:36 user nova-compute[82184]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=82184) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 01:45:36 user nova-compute[82184]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 12 01:45:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:45:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.025s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:45:36 user nova-compute[82184]: INFO nova.virt.driver [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 12 01:45:37 user nova-compute[82184]: INFO nova.compute.provider_config [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] Acquiring lock "singleton_lock" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] Acquired lock "singleton_lock" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] Releasing lock "singleton_lock" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] Full set of CONF: {{(pid=82184) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ******************************************************************************** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] Configuration options gathered from: {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ================================================================================ {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] allow_resize_to_same_host      = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] arq_binding_timeout            = 300 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] backdoor_port                  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] backdoor_socket                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] block_device_allocate_retries  = 300 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] block_device_allocate_retries_interval = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cert                           = self.pem {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute_monitors               = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] config_dir                     = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] config_drive_format            = iso9660 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] config_source                  = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] console_host                   = user {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] control_exchange               = nova {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cpu_allocation_ratio           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] daemon                         = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] debug                          = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] default_access_ip_network_name = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] default_availability_zone      = nova {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] default_ephemeral_format       = ext4 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] default_schedule_zone          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] disk_allocation_ratio          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] enable_new_services            = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] enabled_apis                   = ['osapi_compute'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] enabled_ssl_apis               = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] flat_injected                  = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] force_config_drive             = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] force_raw_images               = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] graceful_shutdown_timeout      = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] heal_instance_info_cache_interval = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] host                           = user {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] instance_build_timeout         = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] instance_delete_interval       = 300 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] instance_format                = [instance: %(uuid)s]  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] instance_name_template         = instance-%08x {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] instance_usage_audit           = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] instance_usage_audit_period    = month {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] internal_service_availability_zone = internal {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] key                            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] live_migration_retry_count     = 30 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] log_config_append              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] log_dir                        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] log_file                       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] log_options                    = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] log_rotate_interval            = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] log_rotate_interval_type       = days {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] log_rotation_type              = none {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] long_rpc_timeout               = 1800 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] max_concurrent_builds          = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] max_concurrent_live_migrations = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] max_concurrent_snapshots       = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] max_local_block_devices        = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] max_logfile_count              = 30 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] max_logfile_size_mb            = 200 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] maximum_instance_delete_attempts = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] metadata_listen                = 0.0.0.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] metadata_listen_port           = 8775 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] metadata_workers               = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] migrate_max_retries            = -1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] mkisofs_cmd                    = genisoimage {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] my_ip                          = 10.0.0.210 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] network_allocate_retries       = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] osapi_compute_listen_port      = 8774 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] osapi_compute_unique_server_name_scope =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] osapi_compute_workers          = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] password_length                = 12 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] periodic_enable                = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] periodic_fuzzy_delay           = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] pointer_model                  = ps2mouse {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] preallocate_images             = none {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] publish_errors                 = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] pybasedir                      = /opt/stack/nova {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ram_allocation_ratio           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] rate_limit_burst               = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] rate_limit_except_level        = CRITICAL {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] rate_limit_interval            = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] reboot_timeout                 = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] reclaim_instance_interval      = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] record                         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] reimage_timeout_per_gb         = 20 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] report_interval                = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] rescue_timeout                 = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] reserved_host_cpus             = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] reserved_host_disk_mb          = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] reserved_host_memory_mb        = 512 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] reserved_huge_pages            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] resize_confirm_window          = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] resize_fs_using_block_device   = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] resume_guests_state_on_host_boot = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] rpc_response_timeout           = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] run_external_periodic_tasks    = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] running_deleted_instance_action = reap {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] running_deleted_instance_poll_interval = 1800 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] running_deleted_instance_timeout = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler_instance_sync_interval = 120 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_down_time              = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] servicegroup_driver            = db {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] shelved_offload_time           = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] shelved_poll_interval          = 3600 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] shutdown_timeout               = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] source_is_ipv6                 = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ssl_only                       = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] state_path                     = /opt/stack/data/nova {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] sync_power_state_interval      = 600 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] sync_power_state_pool_size     = 1000 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] syslog_log_facility            = LOG_USER {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] tempdir                        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] timeout_nbd                    = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] transport_url                  = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] update_resources_interval      = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] use_cow_images                 = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] use_eventlog                   = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] use_journal                    = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] use_json                       = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] use_rootwrap_daemon            = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] use_stderr                     = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] use_syslog                     = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vcpu_pin_set                   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plugging_is_fatal          = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plugging_timeout           = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] virt_mkfs                      = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] volume_usage_poll_interval     = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] watch_log_file                 = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] web                            = /usr/share/spice-html5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_concurrency.disable_process_locking = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.auth_strategy              = keystone {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.compute_link_prefix        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.dhcp_domain                = novalocal {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.enable_instance_password   = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.glance_link_prefix         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.instance_list_per_project_cells = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.list_records_by_skipping_down_cells = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.local_metadata_per_cell    = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.max_limit                  = 1000 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.metadata_cache_expiration  = 15 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.neutron_default_tenant_id  = default {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.use_forwarded_for          = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.use_neutron_default_nets   = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.vendordata_dynamic_targets = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.vendordata_jsonfile_path   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.backend                  = dogpile.cache.memcached {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.backend_argument         = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.config_prefix            = cache.oslo {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.dead_timeout             = 60.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.debug_cache_backend      = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.enable_retry_client      = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.enable_socket_keepalive  = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.enabled                  = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.expiration_time          = 600 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.hashclient_retry_attempts = 2 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.memcache_dead_retry      = 300 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.memcache_password        =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.memcache_pool_maxsize    = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.memcache_sasl_enabled    = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.memcache_username        =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.proxies                  = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.retry_attempts           = 2 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.retry_delay              = 0.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.socket_keepalive_count   = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.socket_keepalive_idle    = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.socket_keepalive_interval = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.tls_allowed_ciphers      = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.tls_cafile               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.tls_certfile             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.tls_enabled              = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cache.tls_keyfile              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.auth_section            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.auth_type               = password {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.cafile                  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.certfile                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.collect_timing          = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.cross_az_attach         = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.debug                   = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.endpoint_template       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.http_retries            = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.insecure                = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.keyfile                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.os_region_name          = RegionOne {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.split_loggers           = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cinder.timeout                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.cpu_dedicated_set      = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.cpu_shared_set         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.image_type_exclude_list = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.max_concurrent_disk_ops = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.max_disk_devices_to_attach = -1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.resource_provider_association_refresh = 300 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.shutdown_retry_interval = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] conductor.workers              = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] console.allowed_origins        = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] console.ssl_ciphers            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] console.ssl_minimum_version    = default {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] consoleauth.token_ttl          = 600 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.cafile                  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.certfile                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.collect_timing          = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.connect_retries         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.connect_retry_delay     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.endpoint_override       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.insecure                = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.keyfile                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.max_version             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.min_version             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.region_name             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.service_name            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.service_type            = accelerator {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.split_loggers           = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.status_code_retries     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.status_code_retry_delay = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.timeout                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] cyborg.version                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.backend               = sqlalchemy {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.connection            = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.connection_debug      = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.connection_parameters =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.connection_recycle_time = 3600 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.connection_trace      = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.db_inc_retry_interval = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.db_max_retries        = 20 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.db_max_retry_interval = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.db_retry_interval     = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.max_overflow          = 50 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.max_pool_size         = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.max_retries           = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.mysql_enable_ndb      = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.mysql_wsrep_sync_wait = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.pool_timeout          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.retry_interval        = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.slave_connection      = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] database.sqlite_synchronous    = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.backend           = sqlalchemy {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.connection        = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.connection_debug  = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.connection_parameters =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.connection_recycle_time = 3600 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.connection_trace  = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.db_inc_retry_interval = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.db_max_retries    = 20 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.db_max_retry_interval = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.db_retry_interval = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.max_overflow      = 50 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.max_pool_size     = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.max_retries       = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.mysql_enable_ndb  = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.pool_timeout      = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.retry_interval    = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.slave_connection  = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] api_database.sqlite_synchronous = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] devices.enabled_mdev_types     = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ephemeral_storage_encryption.enabled = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.api_servers             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.cafile                  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.certfile                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.collect_timing          = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.connect_retries         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.connect_retry_delay     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.debug                   = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.default_trusted_certificate_ids = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.enable_certificate_validation = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.enable_rbd_download     = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.endpoint_override       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.insecure                = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.keyfile                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.max_version             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.min_version             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.num_retries             = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.rbd_ceph_conf           =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.rbd_connect_timeout     = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.rbd_pool                =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.rbd_user                =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.region_name             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.service_name            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.service_type            = image {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.split_loggers           = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.status_code_retries     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.status_code_retry_delay = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.timeout                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.verify_glance_signatures = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] glance.version                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] guestfs.debug                  = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.config_drive_cdrom      = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.config_drive_inject_password = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.enable_instance_metrics_collection = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.enable_remotefx         = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.instances_path_share    =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.iscsi_initiator_list    = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.limit_cpu_features      = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.power_state_check_timeframe = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.use_multipath_io        = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.volume_attach_retry_count = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.vswitch_name            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] mks.enabled                    = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] image_cache.manager_interval   = 2400 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] image_cache.precache_concurrency = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] image_cache.remove_unused_base_images = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] image_cache.subdirectory_name  = _base {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.api_max_retries         = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.api_retry_interval      = 2 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.auth_section            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.auth_type               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.cafile                  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.certfile                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.collect_timing          = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.connect_retries         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.connect_retry_delay     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.endpoint_override       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.insecure                = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.keyfile                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.max_version             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.min_version             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.partition_key           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.peer_list               = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.region_name             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.serial_console_state_timeout = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.service_name            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.service_type            = baremetal {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.split_loggers           = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.status_code_retries     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.status_code_retry_delay = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.timeout                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ironic.version                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] key_manager.fixed_key          = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.barbican_api_version  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.barbican_endpoint     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.barbican_endpoint_type = public {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.barbican_region_name  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.cafile                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.certfile              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.collect_timing        = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.insecure              = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.keyfile               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.number_of_retries     = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.retry_delay           = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.send_service_user_token = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.split_loggers         = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.timeout               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.verify_ssl            = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican.verify_ssl_path       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican_service_user.auth_section = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican_service_user.auth_type = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican_service_user.cafile   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican_service_user.certfile = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican_service_user.collect_timing = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican_service_user.insecure = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican_service_user.keyfile  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican_service_user.split_loggers = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] barbican_service_user.timeout  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.approle_role_id          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.approle_secret_id        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.cafile                   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.certfile                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.collect_timing           = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.insecure                 = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.keyfile                  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.kv_mountpoint            = secret {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.kv_version               = 2 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.namespace                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.root_token_id            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.split_loggers            = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.ssl_ca_crt_file          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.timeout                  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.use_ssl                  = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.cafile                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.certfile              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.collect_timing        = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.connect_retries       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.connect_retry_delay   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.endpoint_override     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.insecure              = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.keyfile               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.max_version           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.min_version           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.region_name           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.service_name          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.service_type          = identity {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.split_loggers         = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.status_code_retries   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.status_code_retry_delay = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.timeout               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] keystone.version               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.connection_uri         =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.cpu_mode               = custom {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: WARNING oslo_config.cfg [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.cpu_power_governor_high = performance {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.cpu_power_governor_low = powersave {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.cpu_power_management   = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.device_detach_attempts = 8 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.device_detach_timeout  = 20 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.disk_cachemodes        = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.disk_prefix            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.enabled_perf_events    = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.file_backed_memory     = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.gid_maps               = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.hw_disk_discard        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.hw_machine_type        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.images_rbd_glance_store_name =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.images_rbd_pool        = rbd {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.images_type            = default {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.images_volume_group    = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.inject_key             = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.inject_partition       = -2 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.inject_password        = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.iscsi_iface            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.iser_use_multipath     = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_bandwidth = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_downtime = 500 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_inbound_addr = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_permit_post_copy = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_scheme  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_timeout_action = abort {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_tunnelled = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: WARNING oslo_config.cfg [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 12 01:45:37 user nova-compute[82184]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 12 01:45:37 user nova-compute[82184]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 12 01:45:37 user nova-compute[82184]: and ``live_migration_inbound_addr`` respectively.
Apr 12 01:45:37 user nova-compute[82184]: ).  Its value may be silently ignored in the future.
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.live_migration_with_native_tls = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.max_queues             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.nfs_mount_options      = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.num_memory_encrypted_guests = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.num_pcie_ports         = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.pmem_namespaces        = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.quobyte_client_cfg     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.rbd_secret_uuid        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.rbd_user               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.remote_filesystem_transport = ssh {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.rescue_image_id        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.rescue_kernel_id       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.rescue_ramdisk_id      = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.rx_queue_size          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.smbfs_mount_options    =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.snapshot_compression   = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.snapshot_image_format  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.sparse_logical_volumes = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.swtpm_enabled          = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.swtpm_group            = tss {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.swtpm_user             = tss {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.sysinfo_serial         = unique {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.tx_queue_size          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.uid_maps               = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.use_virtio_for_bridges = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.virt_type              = kvm {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.volume_clear           = zero {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.volume_clear_size      = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.volume_use_multipath   = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.vzstorage_cache_path   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.vzstorage_mount_user   = stack {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.auth_section           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.auth_type              = password {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.cafile                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.certfile               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.collect_timing         = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.connect_retries        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.connect_retry_delay    = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.default_floating_pool  = public {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.endpoint_override      = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.extension_sync_interval = 600 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.http_retries           = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.insecure               = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.keyfile                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.max_version            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.min_version            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.ovs_bridge             = br-int {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.physnets               = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.region_name            = RegionOne {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.service_metadata_proxy = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.service_name           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.service_type           = network {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.split_loggers          = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.status_code_retries    = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.status_code_retry_delay = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.timeout                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] neutron.version                = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] notifications.bdms_in_notifications = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] notifications.default_level    = INFO {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] notifications.notification_format = unversioned {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] notifications.notify_on_state_change = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] pci.alias                      = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] pci.device_spec                = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] pci.report_in_placement        = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.auth_section         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.auth_type            = password {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.cafile               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.certfile             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.collect_timing       = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.connect_retries      = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.connect_retry_delay  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.default_domain_id    = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.default_domain_name  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.domain_id            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.domain_name          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.endpoint_override    = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.insecure             = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.keyfile              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.max_version          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.min_version          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.password             = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.project_domain_id    = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.project_domain_name  = Default {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.project_id           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.project_name         = service {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.region_name          = RegionOne {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.service_name         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.service_type         = placement {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.split_loggers        = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.status_code_retries  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.status_code_retry_delay = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.system_scope         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.timeout              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.trust_id             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.user_domain_id       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.user_domain_name     = Default {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.user_id              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.username             = placement {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] placement.version              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.cores                    = 20 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.count_usage_from_placement = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.injected_file_content_bytes = 10240 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.injected_file_path_length = 255 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.injected_files           = 5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.instances                = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.key_pairs                = 100 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.metadata_items           = 128 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.ram                      = 51200 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.recheck_quota            = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.server_group_members     = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] quota.server_groups            = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] rdp.enabled                    = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.image_metadata_prefilter = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.max_attempts         = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.max_placement_results = 1000 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.query_placement_for_availability_zone = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.query_placement_for_image_type_support = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] scheduler.workers              = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.host_subset_size = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.isolated_hosts = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.isolated_images = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.pci_in_placement = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.track_instance_changes = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] metrics.required               = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] metrics.weight_multiplier      = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] metrics.weight_setting         = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] serial_console.enabled         = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] serial_console.port_range      = 10000:20000 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] serial_console.serialproxy_port = 6083 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_user.auth_section      = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_user.auth_type         = password {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_user.cafile            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_user.certfile          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_user.collect_timing    = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_user.insecure          = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_user.keyfile           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_user.send_service_user_token = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_user.split_loggers     = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] service_user.timeout           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.agent_enabled            = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.enabled                  = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.html5proxy_port          = 6082 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.image_compression        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.jpeg_compression         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.playback_compression     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.server_listen            = 127.0.0.1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.streaming_mode           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] spice.zlib_compression         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] upgrade_levels.baseapi         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] upgrade_levels.cert            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] upgrade_levels.compute         = auto {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] upgrade_levels.conductor       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] upgrade_levels.scheduler       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vendordata_dynamic_auth.auth_section = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vendordata_dynamic_auth.auth_type = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vendordata_dynamic_auth.cafile = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vendordata_dynamic_auth.certfile = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vendordata_dynamic_auth.insecure = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vendordata_dynamic_auth.keyfile = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vendordata_dynamic_auth.timeout = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.api_retry_count         = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.ca_file                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.cache_prefix            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.cluster_name            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.connection_pool_size    = 10 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.console_delay_seconds   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.datastore_regex         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.host_ip                 = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.host_password           = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.host_port               = 443 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.host_username           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.insecure                = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.integration_bridge      = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.maximum_objects         = 100 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.pbm_default_policy      = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.pbm_enabled             = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.pbm_wsdl_location       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.serial_port_proxy_uri   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.serial_port_service_uri = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.task_poll_interval      = 0.5 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.use_linked_clone        = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.vnc_keymap              = en-us {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.vnc_port                = 5900 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vmware.vnc_port_total          = 10000 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vnc.auth_schemes               = ['none'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vnc.enabled                    = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vnc.novncproxy_port            = 6080 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vnc.server_listen              = 0.0.0.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vnc.vencrypt_ca_certs          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vnc.vencrypt_client_cert       = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vnc.vencrypt_client_key        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.disable_rootwrap   = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.enable_numa_live_migration = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.libvirt_disable_apic = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.client_socket_timeout     = 900 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.default_pool_size         = 1000 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.keep_alive                = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.max_header_line           = 16384 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.ssl_ca_file               = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.ssl_cert_file             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.ssl_key_file              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.tcp_keepidle              = 600 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] zvm.ca_file                    = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] zvm.cloud_connector_url        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] zvm.reachable_timeout          = 300 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_policy.enforce_new_defaults = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_policy.enforce_scope      = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_policy.policy_default_rule = default {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_policy.policy_file        = policy.yaml {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] profiler.connection_string     = messaging:// {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] profiler.enabled               = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] profiler.es_doc_type           = notification {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] profiler.es_scroll_size        = 10000 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] profiler.es_scroll_time        = 2m {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] profiler.filter_error_trace    = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] profiler.hmac_keys             = SECRET_KEY {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] profiler.sentinel_service_name = mymaster {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] profiler.socket_timeout        = 0.1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] profiler.trace_sqlalchemy      = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] remote_debug.host              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] remote_debug.port              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.ssl      = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_notifications.retry = -1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_messaging_notifications.transport_url = **** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.auth_section        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.auth_type           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.cafile              = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.certfile            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.collect_timing      = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.connect_retries     = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.connect_retry_delay = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.endpoint_id         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.endpoint_override   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.insecure            = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.keyfile             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.max_version         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.min_version         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.region_name         = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.service_name        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.service_type        = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.split_loggers       = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.status_code_retries = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.status_code_retry_delay = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.timeout             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.valid_interfaces    = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_limit.version             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_reports.file_event_handler = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] oslo_reports.log_dir           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_ovs_privileged.group  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] vif_plug_ovs_privileged.user   = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_linux_bridge.flat_interface = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_ovs.isolate_vif         = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_vif_ovs.per_port_bridge     = False {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] os_brick.lock_path             = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] privsep_osbrick.capabilities   = [21] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] privsep_osbrick.group          = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] privsep_osbrick.helper_command = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] privsep_osbrick.user           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] nova_sys_admin.group           = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] nova_sys_admin.helper_command  = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] nova_sys_admin.user            = None {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG oslo_service.service [None req-6d1e11a5-2bb2-40ce-b951-6897c505978a None None] ******************************************************************************** {{(pid=82184) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 12 01:45:37 user nova-compute[82184]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 12 01:45:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Starting native event thread {{(pid=82184) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Starting green dispatch thread {{(pid=82184) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Starting connection event dispatch thread {{(pid=82184) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Connecting to libvirt: qemu:///system {{(pid=82184) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f26af2c6650> {{(pid=82184) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 12 01:45:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f26af2c6650> {{(pid=82184) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 12 01:45:37 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Connection event '1' reason 'None'
Apr 12 01:45:37 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 01:45:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.mount [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Initialising _HostMountState generation 0 {{(pid=82184) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 12 01:45:44 user nova-compute[82184]: INFO nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Libvirt host capabilities <capabilities>
Apr 12 01:45:44 user nova-compute[82184]:   <host>
Apr 12 01:45:44 user nova-compute[82184]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 12 01:45:44 user nova-compute[82184]:     <cpu>
Apr 12 01:45:44 user nova-compute[82184]:       <arch>x86_64</arch>
Apr 12 01:45:44 user nova-compute[82184]:       <model>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <vendor>Intel</vendor>
Apr 12 01:45:44 user nova-compute[82184]:       <microcode version='1070'/>
Apr 12 01:45:44 user nova-compute[82184]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 12 01:45:44 user nova-compute[82184]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='ss'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='vmx'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='pcid'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='osxsave'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='hypervisor'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='arat'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='tsc_adjust'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='md-clear'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='arch-capabilities'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='invtsc'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='rsba'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature name='skip-l1dfl-vmentry'/>
Apr 12 01:45:44 user nova-compute[82184]:       <pages unit='KiB' size='4'/>
Apr 12 01:45:44 user nova-compute[82184]:       <pages unit='KiB' size='2048'/>
Apr 12 01:45:44 user nova-compute[82184]:     </cpu>
Apr 12 01:45:44 user nova-compute[82184]:     <power_management>
Apr 12 01:45:44 user nova-compute[82184]:       <suspend_mem/>
Apr 12 01:45:44 user nova-compute[82184]:       <suspend_disk/>
Apr 12 01:45:44 user nova-compute[82184]:       <suspend_hybrid/>
Apr 12 01:45:44 user nova-compute[82184]:     </power_management>
Apr 12 01:45:44 user nova-compute[82184]:     <iommu support='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     <migration_features>
Apr 12 01:45:44 user nova-compute[82184]:       <live/>
Apr 12 01:45:44 user nova-compute[82184]:       <uri_transports>
Apr 12 01:45:44 user nova-compute[82184]:         <uri_transport>tcp</uri_transport>
Apr 12 01:45:44 user nova-compute[82184]:         <uri_transport>rdma</uri_transport>
Apr 12 01:45:44 user nova-compute[82184]:       </uri_transports>
Apr 12 01:45:44 user nova-compute[82184]:     </migration_features>
Apr 12 01:45:44 user nova-compute[82184]:     <topology>
Apr 12 01:45:44 user nova-compute[82184]:       <cells num='2'>
Apr 12 01:45:44 user nova-compute[82184]:         <cell id='0'>
Apr 12 01:45:44 user nova-compute[82184]:           <memory unit='KiB'>8189224</memory>
Apr 12 01:45:44 user nova-compute[82184]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 12 01:45:44 user nova-compute[82184]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 01:45:44 user nova-compute[82184]:           <distances>
Apr 12 01:45:44 user nova-compute[82184]:             <sibling id='0' value='10'/>
Apr 12 01:45:44 user nova-compute[82184]:             <sibling id='1' value='20'/>
Apr 12 01:45:44 user nova-compute[82184]:           </distances>
Apr 12 01:45:44 user nova-compute[82184]:           <cpus num='6'>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 12 01:45:44 user nova-compute[82184]:           </cpus>
Apr 12 01:45:44 user nova-compute[82184]:         </cell>
Apr 12 01:45:44 user nova-compute[82184]:         <cell id='1'>
Apr 12 01:45:44 user nova-compute[82184]:           <memory unit='KiB'>8218764</memory>
Apr 12 01:45:44 user nova-compute[82184]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 12 01:45:44 user nova-compute[82184]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 01:45:44 user nova-compute[82184]:           <distances>
Apr 12 01:45:44 user nova-compute[82184]:             <sibling id='0' value='20'/>
Apr 12 01:45:44 user nova-compute[82184]:             <sibling id='1' value='10'/>
Apr 12 01:45:44 user nova-compute[82184]:           </distances>
Apr 12 01:45:44 user nova-compute[82184]:           <cpus num='6'>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 12 01:45:44 user nova-compute[82184]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 12 01:45:44 user nova-compute[82184]:           </cpus>
Apr 12 01:45:44 user nova-compute[82184]:         </cell>
Apr 12 01:45:44 user nova-compute[82184]:       </cells>
Apr 12 01:45:44 user nova-compute[82184]:     </topology>
Apr 12 01:45:44 user nova-compute[82184]:     <cache>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 12 01:45:44 user nova-compute[82184]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 12 01:45:44 user nova-compute[82184]:     </cache>
Apr 12 01:45:44 user nova-compute[82184]:     <secmodel>
Apr 12 01:45:44 user nova-compute[82184]:       <model>apparmor</model>
Apr 12 01:45:44 user nova-compute[82184]:       <doi>0</doi>
Apr 12 01:45:44 user nova-compute[82184]:     </secmodel>
Apr 12 01:45:44 user nova-compute[82184]:     <secmodel>
Apr 12 01:45:44 user nova-compute[82184]:       <model>dac</model>
Apr 12 01:45:44 user nova-compute[82184]:       <doi>0</doi>
Apr 12 01:45:44 user nova-compute[82184]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 12 01:45:44 user nova-compute[82184]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 12 01:45:44 user nova-compute[82184]:     </secmodel>
Apr 12 01:45:44 user nova-compute[82184]:   </host>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='alpha'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>clipper</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='armv6l'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>spitz</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>nuri</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>kzm</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sx1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>z2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>tosa</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>n810</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>n800</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>terrier</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>midway</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>microbit</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>verdex</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>highbank</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>akita</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>connex</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>collie</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='armv7l'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>spitz</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>nuri</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>kzm</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sx1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>z2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>tosa</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>n810</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>n800</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>terrier</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>midway</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>microbit</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>verdex</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>highbank</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>akita</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>connex</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>collie</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='aarch64'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>spitz</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>nuri</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>kzm</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sx1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>z2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>tosa</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>n810</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>n800</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>terrier</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>midway</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>microbit</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>verdex</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>raspi3b</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>highbank</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>akita</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>connex</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>collie</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <acpi default='on' toggle='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='cris'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='i686'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>isapc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>microvm</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='kvm'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <pae/>
Apr 12 01:45:44 user nova-compute[82184]:       <nonpae/>
Apr 12 01:45:44 user nova-compute[82184]:       <acpi default='on' toggle='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:       <apic default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='m68k'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>an5206</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>q800</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>next-cube</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='microblaze'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='microblazeel'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='mips'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='16'>malta</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='mipsel'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='16'>malta</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='mips64'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='16'>malta</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>pica61</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>magnum</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='mips64el'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='16'>malta</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>pica61</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>magnum</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='16'>boston</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='ppc'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mac99</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>40p</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>taihu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='ppc64'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>taihu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>40p</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mac99</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='ppc64le'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>taihu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>40p</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>mac99</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='riscv32'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='8'>spike</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>opentitan</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='8'>virt</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='riscv64'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='8'>spike</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>shakti_c</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='8'>virt</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='s390x'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='sh4'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>shix</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>r2d</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='sh4eb'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>shix</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>r2d</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='sparc'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>SS-5</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>SS-20</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>LX</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>SS-4</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>SS-10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>Voyager</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='sparc64'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sun4u</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>niagara</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>sun4v</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='x86_64'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>64</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='1'>isapc</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>microvm</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='kvm'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <acpi default='on' toggle='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:       <apic default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='xtensa'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>sim</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>kc705</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>ml605</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>virt</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>lx200</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>lx60</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]:   <guest>
Apr 12 01:45:44 user nova-compute[82184]:     <os_type>hvm</os_type>
Apr 12 01:45:44 user nova-compute[82184]:     <arch name='xtensaeb'>
Apr 12 01:45:44 user nova-compute[82184]:       <wordsize>32</wordsize>
Apr 12 01:45:44 user nova-compute[82184]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='4'>sim</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>kc705</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>ml605</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>virt</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>lx200</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>lx60</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 01:45:44 user nova-compute[82184]:       <domain type='qemu'/>
Apr 12 01:45:44 user nova-compute[82184]:     </arch>
Apr 12 01:45:44 user nova-compute[82184]:     <features>
Apr 12 01:45:44 user nova-compute[82184]:       <cpuselection/>
Apr 12 01:45:44 user nova-compute[82184]:       <deviceboot/>
Apr 12 01:45:44 user nova-compute[82184]:       <disksnapshot default='on' toggle='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     </features>
Apr 12 01:45:44 user nova-compute[82184]:   </guest>
Apr 12 01:45:44 user nova-compute[82184]: </capabilities>
Apr 12 01:45:44 user nova-compute[82184]: 
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 12 01:45:44 user nova-compute[82184]: <domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 01:45:44 user nova-compute[82184]:   <domain>kvm</domain>
Apr 12 01:45:44 user nova-compute[82184]:   <machine>pc-i440fx-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:   <arch>i686</arch>
Apr 12 01:45:44 user nova-compute[82184]:   <vcpu max='255'/>
Apr 12 01:45:44 user nova-compute[82184]:   <iothreads supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:   <os supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='firmware'/>
Apr 12 01:45:44 user nova-compute[82184]:     <loader supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>rom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pflash</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='readonly'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>yes</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='secure'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </loader>
Apr 12 01:45:44 user nova-compute[82184]:   </os>
Apr 12 01:45:44 user nova-compute[82184]:   <cpu>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-passthrough' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='hostPassthroughMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='maximum' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='maximumMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-model' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <vendor>Intel</vendor>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ss'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='vmx'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pcid'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='hypervisor'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arat'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='umip'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='md-clear'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibpb'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibrs'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='erms'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='lm'/>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='custom' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>qemu64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>qemu32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>phenom</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>n270</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>kvm64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>coreduo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>core2duo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>athlon</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Westmere</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Snowridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Penryn</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G5</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G4</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G1</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Nehalem</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Rome</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Milan</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Dhyana</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cooperlake</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Conroe</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>486</model>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:   </cpu>
Apr 12 01:45:44 user nova-compute[82184]:   <memoryBacking supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='sourceType'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>file</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>anonymous</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>memfd</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:   </memoryBacking>
Apr 12 01:45:44 user nova-compute[82184]:   <devices>
Apr 12 01:45:44 user nova-compute[82184]:     <disk supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='diskDevice'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>disk</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cdrom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>floppy</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>lun</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='bus'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ide</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>fdc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sata</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </disk>
Apr 12 01:45:44 user nova-compute[82184]:     <graphics supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sdl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vnc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>spice</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egl-headless</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </graphics>
Apr 12 01:45:44 user nova-compute[82184]:     <video supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='modelType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cirrus</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vmvga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>qxl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>none</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>bochs</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ramfb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </video>
Apr 12 01:45:44 user nova-compute[82184]:     <hostdev supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='mode'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>subsystem</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='startupPolicy'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>default</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>mandatory</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>requisite</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>optional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='subsysType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pci</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='capsType'/>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='pciBackend'/>
Apr 12 01:45:44 user nova-compute[82184]:     </hostdev>
Apr 12 01:45:44 user nova-compute[82184]:     <rng supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>random</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egd</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>builtin</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </rng>
Apr 12 01:45:44 user nova-compute[82184]:     <filesystem supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='driverType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>path</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>handle</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtiofs</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </filesystem>
Apr 12 01:45:44 user nova-compute[82184]:     <tpm supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-tis</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-crb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>passthrough</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>emulator</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </tpm>
Apr 12 01:45:44 user nova-compute[82184]:   </devices>
Apr 12 01:45:44 user nova-compute[82184]:   <features>
Apr 12 01:45:44 user nova-compute[82184]:     <gic supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     <vmcoreinfo supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <genid supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backingStoreInput supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backup supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <sev supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:   </features>
Apr 12 01:45:44 user nova-compute[82184]: </domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:  {{(pid=82184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 12 01:45:44 user nova-compute[82184]: <domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 01:45:44 user nova-compute[82184]:   <domain>kvm</domain>
Apr 12 01:45:44 user nova-compute[82184]:   <machine>pc-i440fx-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:   <arch>i686</arch>
Apr 12 01:45:44 user nova-compute[82184]:   <vcpu max='255'/>
Apr 12 01:45:44 user nova-compute[82184]:   <iothreads supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:   <os supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='firmware'/>
Apr 12 01:45:44 user nova-compute[82184]:     <loader supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>rom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pflash</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='readonly'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>yes</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='secure'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </loader>
Apr 12 01:45:44 user nova-compute[82184]:   </os>
Apr 12 01:45:44 user nova-compute[82184]:   <cpu>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-passthrough' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='hostPassthroughMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='maximum' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='maximumMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-model' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <vendor>Intel</vendor>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ss'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='vmx'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pcid'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='hypervisor'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arat'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='umip'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='md-clear'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibpb'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibrs'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='erms'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='lm'/>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='custom' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>qemu64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>qemu32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>phenom</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>n270</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>kvm64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>coreduo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>core2duo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>athlon</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Westmere</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Snowridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Penryn</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G5</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G4</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G1</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Nehalem</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Rome</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Milan</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Dhyana</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cooperlake</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Conroe</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>486</model>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:   </cpu>
Apr 12 01:45:44 user nova-compute[82184]:   <memoryBacking supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='sourceType'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>file</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>anonymous</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>memfd</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:   </memoryBacking>
Apr 12 01:45:44 user nova-compute[82184]:   <devices>
Apr 12 01:45:44 user nova-compute[82184]:     <disk supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='diskDevice'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>disk</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cdrom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>floppy</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>lun</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='bus'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ide</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>fdc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sata</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </disk>
Apr 12 01:45:44 user nova-compute[82184]:     <graphics supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sdl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vnc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>spice</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egl-headless</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </graphics>
Apr 12 01:45:44 user nova-compute[82184]:     <video supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='modelType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cirrus</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vmvga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>qxl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>none</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>bochs</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ramfb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </video>
Apr 12 01:45:44 user nova-compute[82184]:     <hostdev supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='mode'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>subsystem</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='startupPolicy'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>default</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>mandatory</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>requisite</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>optional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='subsysType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pci</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='capsType'/>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='pciBackend'/>
Apr 12 01:45:44 user nova-compute[82184]:     </hostdev>
Apr 12 01:45:44 user nova-compute[82184]:     <rng supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>random</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egd</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>builtin</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </rng>
Apr 12 01:45:44 user nova-compute[82184]:     <filesystem supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='driverType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>path</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>handle</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtiofs</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </filesystem>
Apr 12 01:45:44 user nova-compute[82184]:     <tpm supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-tis</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-crb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>passthrough</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>emulator</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </tpm>
Apr 12 01:45:44 user nova-compute[82184]:   </devices>
Apr 12 01:45:44 user nova-compute[82184]:   <features>
Apr 12 01:45:44 user nova-compute[82184]:     <gic supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     <vmcoreinfo supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <genid supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backingStoreInput supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backup supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <sev supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:   </features>
Apr 12 01:45:44 user nova-compute[82184]: </domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:  {{(pid=82184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 12 01:45:44 user nova-compute[82184]: <domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 01:45:44 user nova-compute[82184]:   <domain>kvm</domain>
Apr 12 01:45:44 user nova-compute[82184]:   <machine>pc-q35-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:   <arch>i686</arch>
Apr 12 01:45:44 user nova-compute[82184]:   <vcpu max='288'/>
Apr 12 01:45:44 user nova-compute[82184]:   <iothreads supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:   <os supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='firmware'/>
Apr 12 01:45:44 user nova-compute[82184]:     <loader supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>rom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pflash</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='readonly'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>yes</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='secure'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </loader>
Apr 12 01:45:44 user nova-compute[82184]:   </os>
Apr 12 01:45:44 user nova-compute[82184]:   <cpu>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-passthrough' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='hostPassthroughMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='maximum' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='maximumMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-model' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <vendor>Intel</vendor>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ss'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='vmx'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pcid'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='hypervisor'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arat'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='umip'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='md-clear'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibpb'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibrs'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='erms'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='lm'/>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='custom' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>qemu64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>qemu32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>phenom</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>n270</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>kvm64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>coreduo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>core2duo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>athlon</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Westmere</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Snowridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Penryn</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G5</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G4</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G1</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Nehalem</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Rome</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Milan</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Dhyana</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cooperlake</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Conroe</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>486</model>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:   </cpu>
Apr 12 01:45:44 user nova-compute[82184]:   <memoryBacking supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='sourceType'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>file</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>anonymous</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>memfd</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:   </memoryBacking>
Apr 12 01:45:44 user nova-compute[82184]:   <devices>
Apr 12 01:45:44 user nova-compute[82184]:     <disk supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='diskDevice'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>disk</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cdrom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>floppy</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>lun</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='bus'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>fdc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sata</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </disk>
Apr 12 01:45:44 user nova-compute[82184]:     <graphics supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sdl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vnc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>spice</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egl-headless</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </graphics>
Apr 12 01:45:44 user nova-compute[82184]:     <video supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='modelType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cirrus</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vmvga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>qxl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>none</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>bochs</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ramfb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </video>
Apr 12 01:45:44 user nova-compute[82184]:     <hostdev supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='mode'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>subsystem</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='startupPolicy'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>default</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>mandatory</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>requisite</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>optional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='subsysType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pci</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='capsType'/>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='pciBackend'/>
Apr 12 01:45:44 user nova-compute[82184]:     </hostdev>
Apr 12 01:45:44 user nova-compute[82184]:     <rng supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>random</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egd</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>builtin</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </rng>
Apr 12 01:45:44 user nova-compute[82184]:     <filesystem supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='driverType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>path</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>handle</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtiofs</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </filesystem>
Apr 12 01:45:44 user nova-compute[82184]:     <tpm supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-tis</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-crb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>passthrough</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>emulator</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </tpm>
Apr 12 01:45:44 user nova-compute[82184]:   </devices>
Apr 12 01:45:44 user nova-compute[82184]:   <features>
Apr 12 01:45:44 user nova-compute[82184]:     <gic supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     <vmcoreinfo supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <genid supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backingStoreInput supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backup supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <sev supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:   </features>
Apr 12 01:45:44 user nova-compute[82184]: </domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:  {{(pid=82184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 12 01:45:44 user nova-compute[82184]: <domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 01:45:44 user nova-compute[82184]:   <domain>kvm</domain>
Apr 12 01:45:44 user nova-compute[82184]:   <machine>pc-q35-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:   <arch>i686</arch>
Apr 12 01:45:44 user nova-compute[82184]:   <vcpu max='288'/>
Apr 12 01:45:44 user nova-compute[82184]:   <iothreads supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:   <os supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='firmware'/>
Apr 12 01:45:44 user nova-compute[82184]:     <loader supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>rom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pflash</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='readonly'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>yes</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='secure'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </loader>
Apr 12 01:45:44 user nova-compute[82184]:   </os>
Apr 12 01:45:44 user nova-compute[82184]:   <cpu>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-passthrough' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='hostPassthroughMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='maximum' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='maximumMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-model' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <vendor>Intel</vendor>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ss'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='vmx'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pcid'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='hypervisor'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arat'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='umip'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='md-clear'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibpb'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibrs'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='erms'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='lm'/>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='custom' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>qemu64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>qemu32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>phenom</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>n270</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>kvm64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>coreduo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>core2duo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>athlon</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Westmere</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Snowridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Penryn</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G5</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G4</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G1</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Nehalem</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Rome</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Milan</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Dhyana</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cooperlake</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Conroe</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>486</model>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:   </cpu>
Apr 12 01:45:44 user nova-compute[82184]:   <memoryBacking supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='sourceType'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>file</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>anonymous</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>memfd</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:   </memoryBacking>
Apr 12 01:45:44 user nova-compute[82184]:   <devices>
Apr 12 01:45:44 user nova-compute[82184]:     <disk supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='diskDevice'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>disk</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cdrom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>floppy</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>lun</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='bus'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>fdc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sata</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </disk>
Apr 12 01:45:44 user nova-compute[82184]:     <graphics supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sdl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vnc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>spice</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egl-headless</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </graphics>
Apr 12 01:45:44 user nova-compute[82184]:     <video supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='modelType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cirrus</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vmvga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>qxl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>none</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>bochs</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ramfb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </video>
Apr 12 01:45:44 user nova-compute[82184]:     <hostdev supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='mode'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>subsystem</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='startupPolicy'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>default</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>mandatory</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>requisite</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>optional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='subsysType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pci</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='capsType'/>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='pciBackend'/>
Apr 12 01:45:44 user nova-compute[82184]:     </hostdev>
Apr 12 01:45:44 user nova-compute[82184]:     <rng supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>random</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egd</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>builtin</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </rng>
Apr 12 01:45:44 user nova-compute[82184]:     <filesystem supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='driverType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>path</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>handle</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtiofs</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </filesystem>
Apr 12 01:45:44 user nova-compute[82184]:     <tpm supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-tis</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-crb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>passthrough</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>emulator</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </tpm>
Apr 12 01:45:44 user nova-compute[82184]:   </devices>
Apr 12 01:45:44 user nova-compute[82184]:   <features>
Apr 12 01:45:44 user nova-compute[82184]:     <gic supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     <vmcoreinfo supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <genid supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backingStoreInput supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backup supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <sev supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:   </features>
Apr 12 01:45:44 user nova-compute[82184]: </domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:  {{(pid=82184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 12 01:45:44 user nova-compute[82184]: <domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 01:45:44 user nova-compute[82184]:   <domain>kvm</domain>
Apr 12 01:45:44 user nova-compute[82184]:   <machine>pc-i440fx-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:   <arch>x86_64</arch>
Apr 12 01:45:44 user nova-compute[82184]:   <vcpu max='255'/>
Apr 12 01:45:44 user nova-compute[82184]:   <iothreads supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:   <os supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='firmware'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>efi</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:     <loader supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>rom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pflash</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='readonly'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>yes</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='secure'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </loader>
Apr 12 01:45:44 user nova-compute[82184]:   </os>
Apr 12 01:45:44 user nova-compute[82184]:   <cpu>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-passthrough' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='hostPassthroughMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='maximum' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='maximumMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-model' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <vendor>Intel</vendor>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ss'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='vmx'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pcid'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='hypervisor'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arat'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='umip'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='md-clear'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='invtsc'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibpb'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibrs'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='rsba'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='erms'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='custom' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>qemu64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>qemu32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>phenom</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>n270</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>coreduo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>core2duo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>athlon</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Westmere</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Snowridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Penryn</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G5</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G4</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Opteron_G1</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Nehalem</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Rome</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Milan</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Dhyana</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cooperlake</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Conroe</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>486</model>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:   </cpu>
Apr 12 01:45:44 user nova-compute[82184]:   <memoryBacking supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='sourceType'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>file</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>anonymous</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>memfd</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:   </memoryBacking>
Apr 12 01:45:44 user nova-compute[82184]:   <devices>
Apr 12 01:45:44 user nova-compute[82184]:     <disk supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='diskDevice'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>disk</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cdrom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>floppy</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>lun</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='bus'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ide</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>fdc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sata</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </disk>
Apr 12 01:45:44 user nova-compute[82184]:     <graphics supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sdl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vnc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>spice</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egl-headless</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </graphics>
Apr 12 01:45:44 user nova-compute[82184]:     <video supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='modelType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cirrus</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vmvga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>qxl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>none</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>bochs</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ramfb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </video>
Apr 12 01:45:44 user nova-compute[82184]:     <hostdev supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='mode'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>subsystem</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='startupPolicy'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>default</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>mandatory</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>requisite</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>optional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='subsysType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pci</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='capsType'/>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='pciBackend'/>
Apr 12 01:45:44 user nova-compute[82184]:     </hostdev>
Apr 12 01:45:44 user nova-compute[82184]:     <rng supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>random</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egd</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>builtin</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </rng>
Apr 12 01:45:44 user nova-compute[82184]:     <filesystem supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='driverType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>path</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>handle</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtiofs</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </filesystem>
Apr 12 01:45:44 user nova-compute[82184]:     <tpm supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-tis</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-crb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>passthrough</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>emulator</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </tpm>
Apr 12 01:45:44 user nova-compute[82184]:   </devices>
Apr 12 01:45:44 user nova-compute[82184]:   <features>
Apr 12 01:45:44 user nova-compute[82184]:     <gic supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     <vmcoreinfo supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <genid supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backingStoreInput supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backup supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <sev supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:   </features>
Apr 12 01:45:44 user nova-compute[82184]: </domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:  {{(pid=82184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 12 01:45:44 user nova-compute[82184]: <domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 01:45:44 user nova-compute[82184]:   <domain>kvm</domain>
Apr 12 01:45:44 user nova-compute[82184]:   <machine>pc-i440fx-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:   <arch>x86_64</arch>
Apr 12 01:45:44 user nova-compute[82184]:   <vcpu max='255'/>
Apr 12 01:45:44 user nova-compute[82184]:   <iothreads supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:   <os supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='firmware'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>efi</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:     <loader supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>rom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pflash</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='readonly'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>yes</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='secure'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </loader>
Apr 12 01:45:44 user nova-compute[82184]:   </os>
Apr 12 01:45:44 user nova-compute[82184]:   <cpu>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-passthrough' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='hostPassthroughMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='maximum' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='maximumMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-model' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <vendor>Intel</vendor>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ss'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='vmx'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pcid'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='hypervisor'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arat'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='umip'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='md-clear'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='invtsc'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibpb'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibrs'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='rsba'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='erms'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='custom' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>qemu64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>qemu32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>phenom</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>n270</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>coreduo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>core2duo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>athlon</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Westmere</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Snowridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Penryn</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G5</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G4</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Opteron_G1</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Nehalem</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Rome</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Milan</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Dhyana</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cooperlake</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Conroe</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>486</model>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:   </cpu>
Apr 12 01:45:44 user nova-compute[82184]:   <memoryBacking supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='sourceType'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>file</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>anonymous</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>memfd</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:   </memoryBacking>
Apr 12 01:45:44 user nova-compute[82184]:   <devices>
Apr 12 01:45:44 user nova-compute[82184]:     <disk supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='diskDevice'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>disk</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cdrom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>floppy</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>lun</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='bus'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ide</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>fdc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sata</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </disk>
Apr 12 01:45:44 user nova-compute[82184]:     <graphics supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sdl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vnc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>spice</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egl-headless</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </graphics>
Apr 12 01:45:44 user nova-compute[82184]:     <video supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='modelType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cirrus</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vmvga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>qxl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>none</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>bochs</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ramfb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </video>
Apr 12 01:45:44 user nova-compute[82184]:     <hostdev supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='mode'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>subsystem</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='startupPolicy'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>default</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>mandatory</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>requisite</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>optional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='subsysType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pci</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='capsType'/>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='pciBackend'/>
Apr 12 01:45:44 user nova-compute[82184]:     </hostdev>
Apr 12 01:45:44 user nova-compute[82184]:     <rng supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>random</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egd</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>builtin</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </rng>
Apr 12 01:45:44 user nova-compute[82184]:     <filesystem supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='driverType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>path</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>handle</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtiofs</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </filesystem>
Apr 12 01:45:44 user nova-compute[82184]:     <tpm supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-tis</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-crb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>passthrough</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>emulator</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </tpm>
Apr 12 01:45:44 user nova-compute[82184]:   </devices>
Apr 12 01:45:44 user nova-compute[82184]:   <features>
Apr 12 01:45:44 user nova-compute[82184]:     <gic supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     <vmcoreinfo supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <genid supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backingStoreInput supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backup supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <sev supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:   </features>
Apr 12 01:45:44 user nova-compute[82184]: </domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:  {{(pid=82184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 12 01:45:44 user nova-compute[82184]: <domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 01:45:44 user nova-compute[82184]:   <domain>kvm</domain>
Apr 12 01:45:44 user nova-compute[82184]:   <machine>pc-q35-jammy</machine>
Apr 12 01:45:44 user nova-compute[82184]:   <arch>x86_64</arch>
Apr 12 01:45:44 user nova-compute[82184]:   <vcpu max='288'/>
Apr 12 01:45:44 user nova-compute[82184]:   <iothreads supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:   <os supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='firmware'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>efi</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:     <loader supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>rom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pflash</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='readonly'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>yes</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='secure'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>yes</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </loader>
Apr 12 01:45:44 user nova-compute[82184]:   </os>
Apr 12 01:45:44 user nova-compute[82184]:   <cpu>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-passthrough' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='hostPassthroughMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='maximum' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='maximumMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-model' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <vendor>Intel</vendor>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ss'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='vmx'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pcid'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='hypervisor'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arat'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='umip'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='md-clear'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='invtsc'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibpb'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibrs'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='rsba'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='erms'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='custom' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>qemu64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>qemu32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>phenom</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>n270</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>coreduo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>core2duo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>athlon</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Westmere</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Snowridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Penryn</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G5</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G4</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Opteron_G1</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Nehalem</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Rome</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Milan</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Dhyana</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cooperlake</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Conroe</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>486</model>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:   </cpu>
Apr 12 01:45:44 user nova-compute[82184]:   <memoryBacking supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='sourceType'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>file</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>anonymous</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>memfd</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:   </memoryBacking>
Apr 12 01:45:44 user nova-compute[82184]:   <devices>
Apr 12 01:45:44 user nova-compute[82184]:     <disk supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='diskDevice'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>disk</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cdrom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>floppy</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>lun</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='bus'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>fdc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sata</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </disk>
Apr 12 01:45:44 user nova-compute[82184]:     <graphics supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sdl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vnc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>spice</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egl-headless</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </graphics>
Apr 12 01:45:44 user nova-compute[82184]:     <video supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='modelType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cirrus</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vmvga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>qxl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>none</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>bochs</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ramfb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </video>
Apr 12 01:45:44 user nova-compute[82184]:     <hostdev supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='mode'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>subsystem</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='startupPolicy'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>default</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>mandatory</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>requisite</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>optional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='subsysType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pci</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='capsType'/>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='pciBackend'/>
Apr 12 01:45:44 user nova-compute[82184]:     </hostdev>
Apr 12 01:45:44 user nova-compute[82184]:     <rng supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>random</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egd</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>builtin</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </rng>
Apr 12 01:45:44 user nova-compute[82184]:     <filesystem supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='driverType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>path</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>handle</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtiofs</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </filesystem>
Apr 12 01:45:44 user nova-compute[82184]:     <tpm supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-tis</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-crb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>passthrough</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>emulator</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </tpm>
Apr 12 01:45:44 user nova-compute[82184]:   </devices>
Apr 12 01:45:44 user nova-compute[82184]:   <features>
Apr 12 01:45:44 user nova-compute[82184]:     <gic supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     <vmcoreinfo supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <genid supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backingStoreInput supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backup supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <sev supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:   </features>
Apr 12 01:45:44 user nova-compute[82184]: </domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:  {{(pid=82184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 12 01:45:44 user nova-compute[82184]: <domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 01:45:44 user nova-compute[82184]:   <domain>kvm</domain>
Apr 12 01:45:44 user nova-compute[82184]:   <machine>pc-q35-6.2</machine>
Apr 12 01:45:44 user nova-compute[82184]:   <arch>x86_64</arch>
Apr 12 01:45:44 user nova-compute[82184]:   <vcpu max='288'/>
Apr 12 01:45:44 user nova-compute[82184]:   <iothreads supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:   <os supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='firmware'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>efi</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:     <loader supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>rom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pflash</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='readonly'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>yes</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='secure'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>yes</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>no</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </loader>
Apr 12 01:45:44 user nova-compute[82184]:   </os>
Apr 12 01:45:44 user nova-compute[82184]:   <cpu>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-passthrough' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='hostPassthroughMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='maximum' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='maximumMigratable'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>on</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>off</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='host-model' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <vendor>Intel</vendor>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ss'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='vmx'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pcid'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='hypervisor'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arat'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='umip'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='md-clear'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='invtsc'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibpb'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='ibrs'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-stibp'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='rsba'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='erms'/>
Apr 12 01:45:44 user nova-compute[82184]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:     <mode name='custom' supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>qemu64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>qemu32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>phenom</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>pentium</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>n270</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm64</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>kvm32</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>coreduo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>core2duo</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>athlon</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Westmere</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Snowridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Skylake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>SandyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Penryn</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G5</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G4</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G3</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Opteron_G2</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Opteron_G1</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Nehalem</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>IvyBridge</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Icelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Haswell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Rome</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-Milan</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>EPYC</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Dhyana</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cooperlake</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>Conroe</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='no'>Broadwell</model>
Apr 12 01:45:44 user nova-compute[82184]:       <model usable='yes'>486</model>
Apr 12 01:45:44 user nova-compute[82184]:     </mode>
Apr 12 01:45:44 user nova-compute[82184]:   </cpu>
Apr 12 01:45:44 user nova-compute[82184]:   <memoryBacking supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:     <enum name='sourceType'>
Apr 12 01:45:44 user nova-compute[82184]:       <value>file</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>anonymous</value>
Apr 12 01:45:44 user nova-compute[82184]:       <value>memfd</value>
Apr 12 01:45:44 user nova-compute[82184]:     </enum>
Apr 12 01:45:44 user nova-compute[82184]:   </memoryBacking>
Apr 12 01:45:44 user nova-compute[82184]:   <devices>
Apr 12 01:45:44 user nova-compute[82184]:     <disk supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='diskDevice'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>disk</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cdrom</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>floppy</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>lun</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='bus'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>fdc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sata</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </disk>
Apr 12 01:45:44 user nova-compute[82184]:     <graphics supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='type'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>sdl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vnc</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>spice</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egl-headless</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </graphics>
Apr 12 01:45:44 user nova-compute[82184]:     <video supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='modelType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>cirrus</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>vmvga</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>qxl</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>none</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>bochs</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>ramfb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </video>
Apr 12 01:45:44 user nova-compute[82184]:     <hostdev supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='mode'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>subsystem</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='startupPolicy'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>default</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>mandatory</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>requisite</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>optional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='subsysType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>usb</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>pci</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>scsi</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='capsType'/>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='pciBackend'/>
Apr 12 01:45:44 user nova-compute[82184]:     </hostdev>
Apr 12 01:45:44 user nova-compute[82184]:     <rng supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtio-non-transitional</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>random</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>egd</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>builtin</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </rng>
Apr 12 01:45:44 user nova-compute[82184]:     <filesystem supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='driverType'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>path</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>handle</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>virtiofs</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </filesystem>
Apr 12 01:45:44 user nova-compute[82184]:     <tpm supported='yes'>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='model'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-tis</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>tpm-crb</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:       <enum name='backendModel'>
Apr 12 01:45:44 user nova-compute[82184]:         <value>passthrough</value>
Apr 12 01:45:44 user nova-compute[82184]:         <value>emulator</value>
Apr 12 01:45:44 user nova-compute[82184]:       </enum>
Apr 12 01:45:44 user nova-compute[82184]:     </tpm>
Apr 12 01:45:44 user nova-compute[82184]:   </devices>
Apr 12 01:45:44 user nova-compute[82184]:   <features>
Apr 12 01:45:44 user nova-compute[82184]:     <gic supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:     <vmcoreinfo supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <genid supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backingStoreInput supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <backup supported='yes'/>
Apr 12 01:45:44 user nova-compute[82184]:     <sev supported='no'/>
Apr 12 01:45:44 user nova-compute[82184]:   </features>
Apr 12 01:45:44 user nova-compute[82184]: </domainCapabilities>
Apr 12 01:45:44 user nova-compute[82184]:  {{(pid=82184) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=82184) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=82184) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Checking secure boot support for host arch (x86_64) {{(pid=82184) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Checking secure boot support for host arch (x86_64) {{(pid=82184) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Checking secure boot support for host arch (x86_64) {{(pid=82184) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Checking secure boot support for host arch (x86_64) {{(pid=82184) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Checking secure boot support for host arch (x86_64) {{(pid=82184) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 01:45:44 user nova-compute[82184]: INFO nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Secure Boot support detected
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] cpu compare xml: <cpu match="exact">
Apr 12 01:45:44 user nova-compute[82184]:   <model>Nehalem</model>
Apr 12 01:45:44 user nova-compute[82184]: </cpu>
Apr 12 01:45:44 user nova-compute[82184]:  {{(pid=82184) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 12 01:45:44 user nova-compute[82184]: INFO nova.virt.node [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Generated node identity ab0d5e15-c70b-4898-ad6b-82542f647a5e
Apr 12 01:45:44 user nova-compute[82184]: INFO nova.virt.node [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Wrote node identity ab0d5e15-c70b-4898-ad6b-82542f647a5e to /opt/stack/data/nova/compute_id
Apr 12 01:45:44 user nova-compute[82184]: WARNING nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Compute nodes ['ab0d5e15-c70b-4898-ad6b-82542f647a5e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 12 01:45:44 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 12 01:45:44 user nova-compute[82184]: WARNING nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 01:45:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:45:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:45:45 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:45:45 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Hypervisor/Node resource view: name=user free_ram=10818MB free_disk=27.131175994873047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:45:45 user nova-compute[82184]: WARNING nova.compute.resource_tracker [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] No compute node record for user:ab0d5e15-c70b-4898-ad6b-82542f647a5e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ab0d5e15-c70b-4898-ad6b-82542f647a5e could not be found.
Apr 12 01:45:45 user nova-compute[82184]: INFO nova.compute.resource_tracker [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Compute node record created for user:user with uuid: ab0d5e15-c70b-4898-ad6b-82542f647a5e
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:45:45 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [req-b9aee8c6-78c5-4615-8eff-efc28bddeed7] Created resource provider record via placement API for resource provider with UUID ab0d5e15-c70b-4898-ad6b-82542f647a5e and name user.
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=82184) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 12 01:45:45 user nova-compute[82184]: INFO nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] kernel doesn't support AMD SEV
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Libvirt baseline CPU <cpu>
Apr 12 01:45:45 user nova-compute[82184]:   <arch>x86_64</arch>
Apr 12 01:45:45 user nova-compute[82184]:   <model>Nehalem</model>
Apr 12 01:45:45 user nova-compute[82184]:   <vendor>Intel</vendor>
Apr 12 01:45:45 user nova-compute[82184]:   <topology sockets="6" cores="1" threads="1"/>
Apr 12 01:45:45 user nova-compute[82184]: </cpu>
Apr 12 01:45:45 user nova-compute[82184]:  {{(pid=82184) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Updated inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Updating resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e generation from 0 to 1 during operation: update_inventory {{(pid=82184) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Updating resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e generation from 1 to 2 during operation: update_traits {{(pid=82184) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.724s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.service [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Creating RPC server for service compute {{(pid=82184) start /opt/stack/nova/nova/service.py:182}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.service [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Join ServiceGroup membership for this service compute {{(pid=82184) start /opt/stack/nova/nova/service.py:199}}
Apr 12 01:45:45 user nova-compute[82184]: DEBUG nova.servicegroup.drivers.db [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=82184) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 12 01:46:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:27 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:46:36 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:46:37 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:46:37 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:46:37 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=10148MB free_disk=27.044960021972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:46:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:46:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:46:37 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:46:37 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:46:37 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:46:37 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:46:37 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:46:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:47:37 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:47:38 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:47:38 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:47:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=10139MB free_disk=27.088973999023438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:47:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:47:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:47:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:47:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:47:38 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:47:38 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:47:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:47:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:47:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:47:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:47:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:47:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:47:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:47:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:47:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:48:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:48:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:48:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:48:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:48:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:48:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:48:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:48:37 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:48:38 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:48:38 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:48:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=10130MB free_disk=26.867061614990234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:48:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:48:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:48:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:48:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:48:38 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:48:38 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:48:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:48:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:48:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:48:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:48:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:48:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:48:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:48:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:48:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:48:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:48:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:49:38 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:38 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:49:39 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:49:39 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:49:39 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=9421MB free_disk=26.889617919921875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:49:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:39 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:49:39 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:49:39 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:49:39 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:49:39 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:49:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:49:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:49:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:49:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:49:49 user nova-compute[82184]: INFO nova.compute.claims [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Claim successful on node user
Apr 12 01:49:49 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:49:49 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:49:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:49:49 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Creating image(s)
Apr 12 01:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.024s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG nova.policy [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '889189da060e4b54a48ce9a013e04a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fed0886b2404f41a659dc6356771e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690.part --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690.part --force-share --output=json" returned: 0 in 0.161s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG nova.virt.images [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] 16f93c82-82f4-4843-b632-b6b6fe0b6c16 was qcow2, converting to raw {{(pid=82184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690.part /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690.converted {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:49:50 user nova-compute[82184]: INFO nova.compute.claims [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Claim successful on node user
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690.part /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690.converted" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690.converted --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.091s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:51 user nova-compute[82184]: INFO oslo.privsep.daemon [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpeo6y2hyj/privsep.sock']
Apr 12 01:49:51 user sudo[90918]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpeo6y2hyj/privsep.sock
Apr 12 01:49:51 user sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.295s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:49:51 user nova-compute[82184]: INFO nova.compute.claims [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Claim successful on node user
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:49:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.policy [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8e8b9f0307b4d3fb54d89962798026b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117589cba4a54dd581f4ec5c26b4cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:49:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Creating image(s)
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.583s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:49:51 user nova-compute[82184]: INFO nova.compute.claims [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Claim successful on node user
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.network.neutron [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:49:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:49:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Creating image(s)
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:49:51 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG nova.policy [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '889189da060e4b54a48ce9a013e04a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fed0886b2404f41a659dc6356771e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:49:52 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:49:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:49:52 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Creating image(s)
Apr 12 01:49:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "/opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "/opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG nova.network.neutron [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Successfully created port: af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG nova.policy [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '728c534ef1f54c50ad2b619b44c3b9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021f9aee2b7849ef8fcd67d6d6522d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:49:52 user sudo[90918]: pam_unix(sudo:session): session closed for user root
Apr 12 01:49:52 user nova-compute[82184]: INFO oslo.privsep.daemon [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Spawned new privsep daemon via rootwrap
Apr 12 01:49:52 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 01:49:52 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 01:49:52 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 12 01:49:52 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90923
Apr 12 01:49:52 user nova-compute[82184]: WARNING oslo_privsep.priv_context [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] privsep daemon already running
Apr 12 01:49:52 user nova-compute[82184]: WARNING oslo_privsep.priv_context [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] privsep daemon already running
Apr 12 01:49:52 user nova-compute[82184]: WARNING oslo_privsep.priv_context [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] privsep daemon already running
Apr 12 01:49:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.162s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk 1073741824" returned: 0 in 0.047s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.169s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:49:53 user nova-compute[82184]: INFO nova.compute.claims [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Claim successful on node user
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk 1073741824" returned: 0 in 0.055s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.398s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Cannot resize image /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.objects.instance [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'migration_context' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Ensure instance console log exists: /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.154s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.160s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk 1073741824" returned: 0 in 0.050s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.614s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Successfully created port: 365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Cannot resize image /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.objects.instance [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'migration_context' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Ensure instance console log exists: /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.127s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.149s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk 1073741824" returned: 0 in 0.061s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Cannot resize image /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.objects.instance [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'migration_context' on Instance uuid d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Ensure instance console log exists: /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.154s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:49:54 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Cannot resize image /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lazy-loading 'migration_context' on Instance uuid dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Ensure instance console log exists: /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:49:54 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Creating image(s)
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "/opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "/opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "/opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.policy [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c503a0141cf4794bf4e6faba59bdba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a7713a76bb546d2a348927f18b12eb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Successfully created port: 7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.148s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.157s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk 1073741824" returned: 0 in 0.053s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Checking if we can resize image /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:49:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:55 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Cannot resize image /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:49:55 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lazy-loading 'migration_context' on Instance uuid 371f55da-306a-4ef9-b04f-7c22e8071e5c {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:49:55 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:49:55 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Ensure instance console log exists: /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:49:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:55 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Successfully created port: d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:49:56 user nova-compute[82184]: INFO nova.compute.claims [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Claim successful on node user
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Successfully updated port: 365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Successfully updated port: 7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquired lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:49:56 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Successfully created port: f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Successfully updated port: af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquired lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:49:56 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Creating image(s)
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "/opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "/opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-c2a93990-10c5-44fa-9a29-7c141bb765db req-b0cab9a8-be94-4826-a481-6311394f755d service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-changed-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-c2a93990-10c5-44fa-9a29-7c141bb765db req-b0cab9a8-be94-4826-a481-6311394f755d service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Refreshing instance network info cache due to event network-changed-365b7a91-793f-4aaf-af62-4e1c45d300e8. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c2a93990-10c5-44fa-9a29-7c141bb765db req-b0cab9a8-be94-4826-a481-6311394f755d service nova] Acquiring lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.150s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-cea7c8d1-4c61-4bcd-aa4d-ef423e185f00 req-0faed6c6-482f-4df6-8674-c0535a9f0bdc service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-changed-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-cea7c8d1-4c61-4bcd-aa4d-ef423e185f00 req-0faed6c6-482f-4df6-8674-c0535a9f0bdc service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Refreshing instance network info cache due to event network-changed-7edd32c8-a71c-4552-bb85-a073a178f87d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:49:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cea7c8d1-4c61-4bcd-aa4d-ef423e185f00 req-0faed6c6-482f-4df6-8674-c0535a9f0bdc service nova] Acquiring lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.neutron [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.compute.manager [req-d5669752-d3a4-4357-9d04-519b9f6ce224 req-34edeaed-b025-4b7e-83b9-2d4bd9c4a4a8 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-changed-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.compute.manager [req-d5669752-d3a4-4357-9d04-519b9f6ce224 req-34edeaed-b025-4b7e-83b9-2d4bd9c4a4a8 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Refreshing instance network info cache due to event network-changed-af0cfa6a-437f-4754-87f3-f5715490cbbf. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d5669752-d3a4-4357-9d04-519b9f6ce224 req-34edeaed-b025-4b7e-83b9-2d4bd9c4a4a8 service nova] Acquiring lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.policy [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2ca4855c3e9461cb27c88469086d7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c34bd636a2a54b249dca9ce9027ebf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk 1073741824" returned: 0 in 0.166s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.187s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.neutron [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updating instance_info_cache with network_info: [{"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Releasing lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Instance network_info: |[{"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cea7c8d1-4c61-4bcd-aa4d-ef423e185f00 req-0faed6c6-482f-4df6-8674-c0535a9f0bdc service nova] Acquired lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.neutron [req-cea7c8d1-4c61-4bcd-aa4d-ef423e185f00 req-0faed6c6-482f-4df6-8674-c0535a9f0bdc service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Refreshing network info cache for port 7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Start _get_guest_xml network_info=[{"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:49:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:49:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-808158946',display_name='tempest-ServerRescueNegativeTestJSON-server-808158946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-808158946',id=3,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-v56w4pkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:52Z,user_data=None,user_id='889189da060e4b54a48ce9a013e04a3d',uuid=d5c21fac-9fd9-46f8-851e-d1727f5ab0b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3b:63,bridge_name='br-int',has_traffic_filtering=True,id=7edd32c8-a71c-4552-bb85-a073a178f87d,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edd32c8-a7') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.objects.instance [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'pci_devices' on Instance uuid d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Cannot resize image /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.objects.instance [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'migration_context' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Ensure instance console log exists: /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:49:57 user nova-compute[82184]:   <uuid>d5c21fac-9fd9-46f8-851e-d1727f5ab0b9</uuid>
Apr 12 01:49:57 user nova-compute[82184]:   <name>instance-00000003</name>
Apr 12 01:49:57 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:49:57 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:49:57 user nova-compute[82184]:   <metadata>
Apr 12 01:49:57 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:49:57 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-808158946</nova:name>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:49:57</nova:creationTime>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:49:57 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:49:57 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:owner>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:user uuid="889189da060e4b54a48ce9a013e04a3d">tempest-ServerRescueNegativeTestJSON-502185932-project-member</nova:user>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:project uuid="8fed0886b2404f41a659dc6356771e9c">tempest-ServerRescueNegativeTestJSON-502185932</nova:project>
Apr 12 01:49:57 user nova-compute[82184]:       </nova:owner>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:ports>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:port uuid="7edd32c8-a71c-4552-bb85-a073a178f87d">
Apr 12 01:49:57 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 01:49:57 user nova-compute[82184]:         </nova:port>
Apr 12 01:49:57 user nova-compute[82184]:       </nova:ports>
Apr 12 01:49:57 user nova-compute[82184]:     </nova:instance>
Apr 12 01:49:57 user nova-compute[82184]:   </metadata>
Apr 12 01:49:57 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:49:57 user nova-compute[82184]:     <system>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="serial">d5c21fac-9fd9-46f8-851e-d1727f5ab0b9</entry>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="uuid">d5c21fac-9fd9-46f8-851e-d1727f5ab0b9</entry>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:49:57 user nova-compute[82184]:     </system>
Apr 12 01:49:57 user nova-compute[82184]:   </sysinfo>
Apr 12 01:49:57 user nova-compute[82184]:   <os>
Apr 12 01:49:57 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:49:57 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:49:57 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:49:57 user nova-compute[82184]:   </os>
Apr 12 01:49:57 user nova-compute[82184]:   <features>
Apr 12 01:49:57 user nova-compute[82184]:     <acpi/>
Apr 12 01:49:57 user nova-compute[82184]:     <apic/>
Apr 12 01:49:57 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:49:57 user nova-compute[82184]:   </features>
Apr 12 01:49:57 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:49:57 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:49:57 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:49:57 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:49:57 user nova-compute[82184]:   </clock>
Apr 12 01:49:57 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:49:57 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:49:57 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:49:57 user nova-compute[82184]:   </cpu>
Apr 12 01:49:57 user nova-compute[82184]:   <devices>
Apr 12 01:49:57 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:49:57 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:49:57 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk"/>
Apr 12 01:49:57 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:49:57 user nova-compute[82184]:     </disk>
Apr 12 01:49:57 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:49:57 user nova-compute[82184]:       <mac address="fa:16:3e:8d:3b:63"/>
Apr 12 01:49:57 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:49:57 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:49:57 user nova-compute[82184]:       <target dev="tap7edd32c8-a7"/>
Apr 12 01:49:57 user nova-compute[82184]:     </interface>
Apr 12 01:49:57 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:49:57 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/console.log" append="off"/>
Apr 12 01:49:57 user nova-compute[82184]:     </serial>
Apr 12 01:49:57 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:49:57 user nova-compute[82184]:     <video>
Apr 12 01:49:57 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:49:57 user nova-compute[82184]:     </video>
Apr 12 01:49:57 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:49:57 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:49:57 user nova-compute[82184]:     </rng>
Apr 12 01:49:57 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:49:57 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:49:57 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:49:57 user nova-compute[82184]:     </memballoon>
Apr 12 01:49:57 user nova-compute[82184]:   </devices>
Apr 12 01:49:57 user nova-compute[82184]: </domain>
Apr 12 01:49:57 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-808158946',display_name='tempest-ServerRescueNegativeTestJSON-server-808158946',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-808158946',id=3,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-v56w4pkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:52Z,user_data=None,user_id='889189da060e4b54a48ce9a013e04a3d',uuid=d5c21fac-9fd9-46f8-851e-d1727f5ab0b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3b:63,bridge_name='br-int',has_traffic_filtering=True,id=7edd32c8-a71c-4552-bb85-a073a178f87d,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edd32c8-a7') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG os_vif [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3b:63,bridge_name='br-int',has_traffic_filtering=True,id=7edd32c8-a71c-4552-bb85-a073a178f87d,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edd32c8-a7') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Created schema index Interface.name {{(pid=82184) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Created schema index Port.name {{(pid=82184) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Created schema index Bridge.name {{(pid=82184) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [POLLOUT] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:49:57 user nova-compute[82184]: INFO oslo.privsep.daemon [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpd6xcittn/privsep.sock']
Apr 12 01:49:57 user sudo[91018]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpd6xcittn/privsep.sock
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance network_info: |[{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c2a93990-10c5-44fa-9a29-7c141bb765db req-b0cab9a8-be94-4826-a481-6311394f755d service nova] Acquired lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.neutron [req-c2a93990-10c5-44fa-9a29-7c141bb765db req-b0cab9a8-be94-4826-a481-6311394f755d service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Refreshing network info cache for port 365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:49:57 user sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Start _get_guest_xml network_info=[{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:49:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:49:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-213236224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.objects.instance [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'pci_devices' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:49:57 user nova-compute[82184]:   <uuid>c712f2db-72cb-4136-a719-56057d82fff6</uuid>
Apr 12 01:49:57 user nova-compute[82184]:   <name>instance-00000002</name>
Apr 12 01:49:57 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:49:57 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:49:57 user nova-compute[82184]:   <metadata>
Apr 12 01:49:57 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:49:57 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:name>tempest-ServerActionsTestJSON-server-213236224</nova:name>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:49:57</nova:creationTime>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:49:57 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:49:57 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:owner>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:user uuid="e8e8b9f0307b4d3fb54d89962798026b">tempest-ServerActionsTestJSON-1409832124-project-member</nova:user>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:project uuid="117589cba4a54dd581f4ec5c26b4cd2a">tempest-ServerActionsTestJSON-1409832124</nova:project>
Apr 12 01:49:57 user nova-compute[82184]:       </nova:owner>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:49:57 user nova-compute[82184]:       <nova:ports>
Apr 12 01:49:57 user nova-compute[82184]:         <nova:port uuid="365b7a91-793f-4aaf-af62-4e1c45d300e8">
Apr 12 01:49:57 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 01:49:57 user nova-compute[82184]:         </nova:port>
Apr 12 01:49:57 user nova-compute[82184]:       </nova:ports>
Apr 12 01:49:57 user nova-compute[82184]:     </nova:instance>
Apr 12 01:49:57 user nova-compute[82184]:   </metadata>
Apr 12 01:49:57 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:49:57 user nova-compute[82184]:     <system>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="serial">c712f2db-72cb-4136-a719-56057d82fff6</entry>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="uuid">c712f2db-72cb-4136-a719-56057d82fff6</entry>
Apr 12 01:49:57 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:49:57 user nova-compute[82184]:     </system>
Apr 12 01:49:57 user nova-compute[82184]:   </sysinfo>
Apr 12 01:49:57 user nova-compute[82184]:   <os>
Apr 12 01:49:57 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:49:57 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:49:57 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:49:57 user nova-compute[82184]:   </os>
Apr 12 01:49:57 user nova-compute[82184]:   <features>
Apr 12 01:49:57 user nova-compute[82184]:     <acpi/>
Apr 12 01:49:57 user nova-compute[82184]:     <apic/>
Apr 12 01:49:57 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:49:57 user nova-compute[82184]:   </features>
Apr 12 01:49:57 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:49:57 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:49:57 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:49:57 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:49:57 user nova-compute[82184]:   </clock>
Apr 12 01:49:57 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:49:57 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:49:57 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:49:57 user nova-compute[82184]:   </cpu>
Apr 12 01:49:57 user nova-compute[82184]:   <devices>
Apr 12 01:49:57 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:49:57 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:49:57 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk"/>
Apr 12 01:49:57 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:49:57 user nova-compute[82184]:     </disk>
Apr 12 01:49:57 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:49:57 user nova-compute[82184]:       <mac address="fa:16:3e:f9:ed:df"/>
Apr 12 01:49:57 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:49:57 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:49:57 user nova-compute[82184]:       <target dev="tap365b7a91-79"/>
Apr 12 01:49:57 user nova-compute[82184]:     </interface>
Apr 12 01:49:57 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:49:57 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/console.log" append="off"/>
Apr 12 01:49:57 user nova-compute[82184]:     </serial>
Apr 12 01:49:57 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:49:57 user nova-compute[82184]:     <video>
Apr 12 01:49:57 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:49:57 user nova-compute[82184]:     </video>
Apr 12 01:49:57 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:49:57 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:49:57 user nova-compute[82184]:     </rng>
Apr 12 01:49:57 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:49:57 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:49:57 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:49:57 user nova-compute[82184]:     </memballoon>
Apr 12 01:49:57 user nova-compute[82184]:   </devices>
Apr 12 01:49:57 user nova-compute[82184]: </domain>
Apr 12 01:49:57 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-213236224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG os_vif [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updating instance_info_cache with network_info: [{"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Releasing lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.compute.manager [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Instance network_info: |[{"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [req-cea7c8d1-4c61-4bcd-aa4d-ef423e185f00 req-0faed6c6-482f-4df6-8674-c0535a9f0bdc service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updated VIF entry in instance network info cache for port 7edd32c8-a71c-4552-bb85-a073a178f87d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [req-cea7c8d1-4c61-4bcd-aa4d-ef423e185f00 req-0faed6c6-482f-4df6-8674-c0535a9f0bdc service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updating instance_info_cache with network_info: [{"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d5669752-d3a4-4357-9d04-519b9f6ce224 req-34edeaed-b025-4b7e-83b9-2d4bd9c4a4a8 service nova] Acquired lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [req-d5669752-d3a4-4357-9d04-519b9f6ce224 req-34edeaed-b025-4b7e-83b9-2d4bd9c4a4a8 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Refreshing network info cache for port af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Start _get_guest_xml network_info=[{"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cea7c8d1-4c61-4bcd-aa4d-ef423e185f00 req-0faed6c6-482f-4df6-8674-c0535a9f0bdc service nova] Releasing lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:49:59 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:49:59 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-722086832',display_name='tempest-ServerRescueNegativeTestJSON-server-722086832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-722086832',id=1,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-mzuyr7dh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:50Z,user_data=None,user_id='889189da060e4b54a48ce9a013e04a3d',uuid=fdbd8add-ac0e-42ce-9b34-5878c6bec208,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=af0cfa6a-437f-4754-87f3-f5715490cbbf,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0cfa6a-43') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.objects.instance [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'pci_devices' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:49:59 user nova-compute[82184]:   <uuid>fdbd8add-ac0e-42ce-9b34-5878c6bec208</uuid>
Apr 12 01:49:59 user nova-compute[82184]:   <name>instance-00000001</name>
Apr 12 01:49:59 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:49:59 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:49:59 user nova-compute[82184]:   <metadata>
Apr 12 01:49:59 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:49:59 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:49:59 user nova-compute[82184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-722086832</nova:name>
Apr 12 01:49:59 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:49:59</nova:creationTime>
Apr 12 01:49:59 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:49:59 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:49:59 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:49:59 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:49:59 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:49:59 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:49:59 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:49:59 user nova-compute[82184]:       <nova:owner>
Apr 12 01:49:59 user nova-compute[82184]:         <nova:user uuid="889189da060e4b54a48ce9a013e04a3d">tempest-ServerRescueNegativeTestJSON-502185932-project-member</nova:user>
Apr 12 01:49:59 user nova-compute[82184]:         <nova:project uuid="8fed0886b2404f41a659dc6356771e9c">tempest-ServerRescueNegativeTestJSON-502185932</nova:project>
Apr 12 01:49:59 user nova-compute[82184]:       </nova:owner>
Apr 12 01:49:59 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:49:59 user nova-compute[82184]:       <nova:ports>
Apr 12 01:49:59 user nova-compute[82184]:         <nova:port uuid="af0cfa6a-437f-4754-87f3-f5715490cbbf">
Apr 12 01:49:59 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 01:49:59 user nova-compute[82184]:         </nova:port>
Apr 12 01:49:59 user nova-compute[82184]:       </nova:ports>
Apr 12 01:49:59 user nova-compute[82184]:     </nova:instance>
Apr 12 01:49:59 user nova-compute[82184]:   </metadata>
Apr 12 01:49:59 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:49:59 user nova-compute[82184]:     <system>
Apr 12 01:49:59 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:49:59 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:49:59 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:49:59 user nova-compute[82184]:       <entry name="serial">fdbd8add-ac0e-42ce-9b34-5878c6bec208</entry>
Apr 12 01:49:59 user nova-compute[82184]:       <entry name="uuid">fdbd8add-ac0e-42ce-9b34-5878c6bec208</entry>
Apr 12 01:49:59 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:49:59 user nova-compute[82184]:     </system>
Apr 12 01:49:59 user nova-compute[82184]:   </sysinfo>
Apr 12 01:49:59 user nova-compute[82184]:   <os>
Apr 12 01:49:59 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:49:59 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:49:59 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:49:59 user nova-compute[82184]:   </os>
Apr 12 01:49:59 user nova-compute[82184]:   <features>
Apr 12 01:49:59 user nova-compute[82184]:     <acpi/>
Apr 12 01:49:59 user nova-compute[82184]:     <apic/>
Apr 12 01:49:59 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:49:59 user nova-compute[82184]:   </features>
Apr 12 01:49:59 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:49:59 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:49:59 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:49:59 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:49:59 user nova-compute[82184]:   </clock>
Apr 12 01:49:59 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:49:59 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:49:59 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:49:59 user nova-compute[82184]:   </cpu>
Apr 12 01:49:59 user nova-compute[82184]:   <devices>
Apr 12 01:49:59 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:49:59 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:49:59 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk"/>
Apr 12 01:49:59 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:49:59 user nova-compute[82184]:     </disk>
Apr 12 01:49:59 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:49:59 user nova-compute[82184]:       <mac address="fa:16:3e:59:1d:2d"/>
Apr 12 01:49:59 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:49:59 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:49:59 user nova-compute[82184]:       <target dev="tapaf0cfa6a-43"/>
Apr 12 01:49:59 user nova-compute[82184]:     </interface>
Apr 12 01:49:59 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:49:59 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/console.log" append="off"/>
Apr 12 01:49:59 user nova-compute[82184]:     </serial>
Apr 12 01:49:59 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:49:59 user nova-compute[82184]:     <video>
Apr 12 01:49:59 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:49:59 user nova-compute[82184]:     </video>
Apr 12 01:49:59 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:49:59 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:49:59 user nova-compute[82184]:     </rng>
Apr 12 01:49:59 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:49:59 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:49:59 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:49:59 user nova-compute[82184]:     </memballoon>
Apr 12 01:49:59 user nova-compute[82184]:   </devices>
Apr 12 01:49:59 user nova-compute[82184]: </domain>
Apr 12 01:49:59 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-722086832',display_name='tempest-ServerRescueNegativeTestJSON-server-722086832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-722086832',id=1,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-mzuyr7dh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:50Z,user_data=None,user_id='889189da060e4b54a48ce9a013e04a3d',uuid=fdbd8add-ac0e-42ce-9b34-5878c6bec208,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=af0cfa6a-437f-4754-87f3-f5715490cbbf,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0cfa6a-43') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG os_vif [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=af0cfa6a-437f-4754-87f3-f5715490cbbf,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0cfa6a-43') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Successfully updated port: d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Successfully updated port: f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "refresh_cache-dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquired lock "refresh_cache-dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [req-c2a93990-10c5-44fa-9a29-7c141bb765db req-b0cab9a8-be94-4826-a481-6311394f755d service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updated VIF entry in instance network info cache for port 365b7a91-793f-4aaf-af62-4e1c45d300e8. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [req-c2a93990-10c5-44fa-9a29-7c141bb765db req-b0cab9a8-be94-4826-a481-6311394f755d service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-9e87c216-6a74-4cd9-affe-0c7db18c7950 req-fb71d2e6-3338-49b6-b9c3-da3454ce7042 service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Received event network-changed-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-9e87c216-6a74-4cd9-affe-0c7db18c7950 req-fb71d2e6-3338-49b6-b9c3-da3454ce7042 service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Refreshing instance network info cache due to event network-changed-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9e87c216-6a74-4cd9-affe-0c7db18c7950 req-fb71d2e6-3338-49b6-b9c3-da3454ce7042 service nova] Acquiring lock "refresh_cache-371f55da-306a-4ef9-b04f-7c22e8071e5c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9e87c216-6a74-4cd9-affe-0c7db18c7950 req-fb71d2e6-3338-49b6-b9c3-da3454ce7042 service nova] Acquired lock "refresh_cache-371f55da-306a-4ef9-b04f-7c22e8071e5c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [req-9e87c216-6a74-4cd9-affe-0c7db18c7950 req-fb71d2e6-3338-49b6-b9c3-da3454ce7042 service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Refreshing network info cache for port f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c2a93990-10c5-44fa-9a29-7c141bb765db req-b0cab9a8-be94-4826-a481-6311394f755d service nova] Releasing lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-8c809fa5-dca2-4b7a-8ba5-d52d15e40209 req-47ec39f9-8210-4646-9083-a2dcd02ec94d service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Received event network-changed-d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-8c809fa5-dca2-4b7a-8ba5-d52d15e40209 req-47ec39f9-8210-4646-9083-a2dcd02ec94d service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Refreshing instance network info cache due to event network-changed-d776e917-e4e5-4688-b138-ffb1eebbb61f. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c809fa5-dca2-4b7a-8ba5-d52d15e40209 req-47ec39f9-8210-4646-9083-a2dcd02ec94d service nova] Acquiring lock "refresh_cache-dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "refresh_cache-371f55da-306a-4ef9-b04f-7c22e8071e5c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:49:59 user sudo[91018]: pam_unix(sudo:session): session closed for user root
Apr 12 01:49:59 user nova-compute[82184]: INFO oslo.privsep.daemon [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Spawned new privsep daemon via rootwrap
Apr 12 01:49:59 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 01:49:59 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 01:49:59 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 12 01:49:59 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91022
Apr 12 01:49:59 user nova-compute[82184]: WARNING oslo_privsep.priv_context [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] privsep daemon already running
Apr 12 01:49:59 user nova-compute[82184]: WARNING oslo_privsep.priv_context [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] privsep daemon already running
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [req-9e87c216-6a74-4cd9-affe-0c7db18c7950 req-fb71d2e6-3338-49b6-b9c3-da3454ce7042 service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:49:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Successfully created port: ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf0cfa6a-43, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf0cfa6a-43, col_values=(('external_ids', {'iface-id': 'af0cfa6a-437f-4754-87f3-f5715490cbbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:1d:2d', 'vm-uuid': 'fdbd8add-ac0e-42ce-9b34-5878c6bec208'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: INFO os_vif [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=af0cfa6a-437f-4754-87f3-f5715490cbbf,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0cfa6a-43')
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap365b7a91-79, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap365b7a91-79, col_values=(('external_ids', {'iface-id': '365b7a91-793f-4aaf-af62-4e1c45d300e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ed:df', 'vm-uuid': 'c712f2db-72cb-4136-a719-56057d82fff6'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: INFO os_vif [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79')
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7edd32c8-a7, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7edd32c8-a7, col_values=(('external_ids', {'iface-id': '7edd32c8-a71c-4552-bb85-a073a178f87d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:3b:63', 'vm-uuid': 'd5c21fac-9fd9-46f8-851e-d1727f5ab0b9'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: INFO os_vif [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:3b:63,bridge_name='br-int',has_traffic_filtering=True,id=7edd32c8-a71c-4552-bb85-a073a178f87d,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edd32c8-a7')
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No VIF found with MAC fa:16:3e:59:1d:2d, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No VIF found with MAC fa:16:3e:f9:ed:df, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No VIF found with MAC fa:16:3e:8d:3b:63, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Updating instance_info_cache with network_info: [{"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-9e87c216-6a74-4cd9-affe-0c7db18c7950 req-fb71d2e6-3338-49b6-b9c3-da3454ce7042 service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9e87c216-6a74-4cd9-affe-0c7db18c7950 req-fb71d2e6-3338-49b6-b9c3-da3454ce7042 service nova] Releasing lock "refresh_cache-371f55da-306a-4ef9-b04f-7c22e8071e5c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquired lock "refresh_cache-371f55da-306a-4ef9-b04f-7c22e8071e5c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.network.neutron [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Releasing lock "refresh_cache-dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Instance network_info: |[{"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c809fa5-dca2-4b7a-8ba5-d52d15e40209 req-47ec39f9-8210-4646-9083-a2dcd02ec94d service nova] Acquired lock "refresh_cache-dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-8c809fa5-dca2-4b7a-8ba5-d52d15e40209 req-47ec39f9-8210-4646-9083-a2dcd02ec94d service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Refreshing network info cache for port d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Start _get_guest_xml network_info=[{"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:50:00 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:00 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-49623664',display_name='tempest-ServersNegativeTestJSON-server-49623664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-49623664',id=4,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='021f9aee2b7849ef8fcd67d6d6522d27',ramdisk_id='',reservation_id='r-8nmxa4pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-292036935',owner_user_name='tempest-ServersNegativeTestJSON-292036935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:52Z,user_data=None,user_id='728c534ef1f54c50ad2b619b44c3b9c7',uuid=dfe43143-ac3d-4aed-9a6e-5ec27fb609e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converting VIF {"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:34:2b,bridge_name='br-int',has_traffic_filtering=True,id=d776e917-e4e5-4688-b138-ffb1eebbb61f,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd776e917-e4') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lazy-loading 'pci_devices' on Instance uuid dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:50:00 user nova-compute[82184]:   <uuid>dfe43143-ac3d-4aed-9a6e-5ec27fb609e4</uuid>
Apr 12 01:50:00 user nova-compute[82184]:   <name>instance-00000004</name>
Apr 12 01:50:00 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:50:00 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:50:00 user nova-compute[82184]:   <metadata>
Apr 12 01:50:00 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:50:00 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:50:00 user nova-compute[82184]:       <nova:name>tempest-ServersNegativeTestJSON-server-49623664</nova:name>
Apr 12 01:50:00 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:50:00</nova:creationTime>
Apr 12 01:50:00 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:50:00 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:50:00 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:50:00 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:50:00 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:50:00 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:50:00 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:50:00 user nova-compute[82184]:       <nova:owner>
Apr 12 01:50:00 user nova-compute[82184]:         <nova:user uuid="728c534ef1f54c50ad2b619b44c3b9c7">tempest-ServersNegativeTestJSON-292036935-project-member</nova:user>
Apr 12 01:50:00 user nova-compute[82184]:         <nova:project uuid="021f9aee2b7849ef8fcd67d6d6522d27">tempest-ServersNegativeTestJSON-292036935</nova:project>
Apr 12 01:50:00 user nova-compute[82184]:       </nova:owner>
Apr 12 01:50:00 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:50:00 user nova-compute[82184]:       <nova:ports>
Apr 12 01:50:00 user nova-compute[82184]:         <nova:port uuid="d776e917-e4e5-4688-b138-ffb1eebbb61f">
Apr 12 01:50:00 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 01:50:00 user nova-compute[82184]:         </nova:port>
Apr 12 01:50:00 user nova-compute[82184]:       </nova:ports>
Apr 12 01:50:00 user nova-compute[82184]:     </nova:instance>
Apr 12 01:50:00 user nova-compute[82184]:   </metadata>
Apr 12 01:50:00 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:50:00 user nova-compute[82184]:     <system>
Apr 12 01:50:00 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:50:00 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:50:00 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:50:00 user nova-compute[82184]:       <entry name="serial">dfe43143-ac3d-4aed-9a6e-5ec27fb609e4</entry>
Apr 12 01:50:00 user nova-compute[82184]:       <entry name="uuid">dfe43143-ac3d-4aed-9a6e-5ec27fb609e4</entry>
Apr 12 01:50:00 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:50:00 user nova-compute[82184]:     </system>
Apr 12 01:50:00 user nova-compute[82184]:   </sysinfo>
Apr 12 01:50:00 user nova-compute[82184]:   <os>
Apr 12 01:50:00 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:50:00 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:50:00 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:50:00 user nova-compute[82184]:   </os>
Apr 12 01:50:00 user nova-compute[82184]:   <features>
Apr 12 01:50:00 user nova-compute[82184]:     <acpi/>
Apr 12 01:50:00 user nova-compute[82184]:     <apic/>
Apr 12 01:50:00 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:50:00 user nova-compute[82184]:   </features>
Apr 12 01:50:00 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:50:00 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:50:00 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:50:00 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:50:00 user nova-compute[82184]:   </clock>
Apr 12 01:50:00 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:50:00 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:50:00 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:50:00 user nova-compute[82184]:   </cpu>
Apr 12 01:50:00 user nova-compute[82184]:   <devices>
Apr 12 01:50:00 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:50:00 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:50:00 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk"/>
Apr 12 01:50:00 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:50:00 user nova-compute[82184]:     </disk>
Apr 12 01:50:00 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:50:00 user nova-compute[82184]:       <mac address="fa:16:3e:1b:34:2b"/>
Apr 12 01:50:00 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:00 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:50:00 user nova-compute[82184]:       <target dev="tapd776e917-e4"/>
Apr 12 01:50:00 user nova-compute[82184]:     </interface>
Apr 12 01:50:00 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:50:00 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/console.log" append="off"/>
Apr 12 01:50:00 user nova-compute[82184]:     </serial>
Apr 12 01:50:00 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:50:00 user nova-compute[82184]:     <video>
Apr 12 01:50:00 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:00 user nova-compute[82184]:     </video>
Apr 12 01:50:00 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:50:00 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:50:00 user nova-compute[82184]:     </rng>
Apr 12 01:50:00 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:50:00 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:50:00 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:50:00 user nova-compute[82184]:     </memballoon>
Apr 12 01:50:00 user nova-compute[82184]:   </devices>
Apr 12 01:50:00 user nova-compute[82184]: </domain>
Apr 12 01:50:00 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-49623664',display_name='tempest-ServersNegativeTestJSON-server-49623664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-49623664',id=4,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='021f9aee2b7849ef8fcd67d6d6522d27',ramdisk_id='',reservation_id='r-8nmxa4pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-292036935',owner_user_name='tempest-ServersNegativeTestJSON-292036935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:52Z,user_data=None,user_id='728c534ef1f54c50ad2b619b44c3b9c7',uuid=dfe43143-ac3d-4aed-9a6e-5ec27fb609e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converting VIF {"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:34:2b,bridge_name='br-int',has_traffic_filtering=True,id=d776e917-e4e5-4688-b138-ffb1eebbb61f,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd776e917-e4') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG os_vif [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:34:2b,bridge_name='br-int',has_traffic_filtering=True,id=d776e917-e4e5-4688-b138-ffb1eebbb61f,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd776e917-e4') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd776e917-e4, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd776e917-e4, col_values=(('external_ids', {'iface-id': 'd776e917-e4e5-4688-b138-ffb1eebbb61f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:34:2b', 'vm-uuid': 'dfe43143-ac3d-4aed-9a6e-5ec27fb609e4'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:00 user nova-compute[82184]: INFO os_vif [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:34:2b,bridge_name='br-int',has_traffic_filtering=True,id=d776e917-e4e5-4688-b138-ffb1eebbb61f,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd776e917-e4')
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] No VIF found with MAC fa:16:3e:1b:34:2b, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG nova.network.neutron [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:50:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Successfully updated port: ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquired lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-d5669752-d3a4-4357-9d04-519b9f6ce224 req-34edeaed-b025-4b7e-83b9-2d4bd9c4a4a8 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updated VIF entry in instance network info cache for port af0cfa6a-437f-4754-87f3-f5715490cbbf. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-d5669752-d3a4-4357-9d04-519b9f6ce224 req-34edeaed-b025-4b7e-83b9-2d4bd9c4a4a8 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updating instance_info_cache with network_info: [{"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d5669752-d3a4-4357-9d04-519b9f6ce224 req-34edeaed-b025-4b7e-83b9-2d4bd9c4a4a8 service nova] Releasing lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-7ee42332-2c70-4798-8827-cb08e86ca8c6 req-a6d3545d-7492-4621-9e1d-b83b2e887b3a service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-changed-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-7ee42332-2c70-4798-8827-cb08e86ca8c6 req-a6d3545d-7492-4621-9e1d-b83b2e887b3a service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Refreshing instance network info cache due to event network-changed-ec368fc5-6d05-4bab-8460-cf9f1e024195. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7ee42332-2c70-4798-8827-cb08e86ca8c6 req-a6d3545d-7492-4621-9e1d-b83b2e887b3a service nova] Acquiring lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Updating instance_info_cache with network_info: [{"id": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "address": "fa:16:3e:79:68:d8", "network": {"id": "0ef60c4f-0414-4002-adfd-b2fd10b1cd53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-791717922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7713a76bb546d2a348927f18b12eb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70a5cfd-b9", "ovs_interfaceid": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Releasing lock "refresh_cache-371f55da-306a-4ef9-b04f-7c22e8071e5c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Instance network_info: |[{"id": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "address": "fa:16:3e:79:68:d8", "network": {"id": "0ef60c4f-0414-4002-adfd-b2fd10b1cd53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-791717922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7713a76bb546d2a348927f18b12eb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70a5cfd-b9", "ovs_interfaceid": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Start _get_guest_xml network_info=[{"id": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "address": "fa:16:3e:79:68:d8", "network": {"id": "0ef60c4f-0414-4002-adfd-b2fd10b1cd53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-791717922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7713a76bb546d2a348927f18b12eb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70a5cfd-b9", "ovs_interfaceid": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:50:01 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:01 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-494306683',display_name='tempest-DeleteServersTestJSON-server-494306683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-494306683',id=5,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a7713a76bb546d2a348927f18b12eb7',ramdisk_id='',reservation_id='r-9sxho75h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-986135774',owner_user_name='tempest-DeleteServersTestJSON-986135774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:54Z,user_data=None,user_id='6c503a0141cf4794bf4e6faba59bdba3',uuid=371f55da-306a-4ef9-b04f-7c22e8071e5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "address": "fa:16:3e:79:68:d8", "network": {"id": "0ef60c4f-0414-4002-adfd-b2fd10b1cd53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-791717922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7713a76bb546d2a348927f18b12eb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70a5cfd-b9", "ovs_interfaceid": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Converting VIF {"id": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "address": "fa:16:3e:79:68:d8", "network": {"id": "0ef60c4f-0414-4002-adfd-b2fd10b1cd53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-791717922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7713a76bb546d2a348927f18b12eb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70a5cfd-b9", "ovs_interfaceid": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:68:d8,bridge_name='br-int',has_traffic_filtering=True,id=f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1,network=Network(0ef60c4f-0414-4002-adfd-b2fd10b1cd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70a5cfd-b9') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lazy-loading 'pci_devices' on Instance uuid 371f55da-306a-4ef9-b04f-7c22e8071e5c {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:50:01 user nova-compute[82184]:   <uuid>371f55da-306a-4ef9-b04f-7c22e8071e5c</uuid>
Apr 12 01:50:01 user nova-compute[82184]:   <name>instance-00000005</name>
Apr 12 01:50:01 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:50:01 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:50:01 user nova-compute[82184]:   <metadata>
Apr 12 01:50:01 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:50:01 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:50:01 user nova-compute[82184]:       <nova:name>tempest-DeleteServersTestJSON-server-494306683</nova:name>
Apr 12 01:50:01 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:50:01</nova:creationTime>
Apr 12 01:50:01 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:50:01 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:50:01 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:50:01 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:50:01 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:50:01 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:50:01 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:50:01 user nova-compute[82184]:       <nova:owner>
Apr 12 01:50:01 user nova-compute[82184]:         <nova:user uuid="6c503a0141cf4794bf4e6faba59bdba3">tempest-DeleteServersTestJSON-986135774-project-member</nova:user>
Apr 12 01:50:01 user nova-compute[82184]:         <nova:project uuid="2a7713a76bb546d2a348927f18b12eb7">tempest-DeleteServersTestJSON-986135774</nova:project>
Apr 12 01:50:01 user nova-compute[82184]:       </nova:owner>
Apr 12 01:50:01 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:50:01 user nova-compute[82184]:       <nova:ports>
Apr 12 01:50:01 user nova-compute[82184]:         <nova:port uuid="f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1">
Apr 12 01:50:01 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 01:50:01 user nova-compute[82184]:         </nova:port>
Apr 12 01:50:01 user nova-compute[82184]:       </nova:ports>
Apr 12 01:50:01 user nova-compute[82184]:     </nova:instance>
Apr 12 01:50:01 user nova-compute[82184]:   </metadata>
Apr 12 01:50:01 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:50:01 user nova-compute[82184]:     <system>
Apr 12 01:50:01 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:50:01 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:50:01 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:50:01 user nova-compute[82184]:       <entry name="serial">371f55da-306a-4ef9-b04f-7c22e8071e5c</entry>
Apr 12 01:50:01 user nova-compute[82184]:       <entry name="uuid">371f55da-306a-4ef9-b04f-7c22e8071e5c</entry>
Apr 12 01:50:01 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:50:01 user nova-compute[82184]:     </system>
Apr 12 01:50:01 user nova-compute[82184]:   </sysinfo>
Apr 12 01:50:01 user nova-compute[82184]:   <os>
Apr 12 01:50:01 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:50:01 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:50:01 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:50:01 user nova-compute[82184]:   </os>
Apr 12 01:50:01 user nova-compute[82184]:   <features>
Apr 12 01:50:01 user nova-compute[82184]:     <acpi/>
Apr 12 01:50:01 user nova-compute[82184]:     <apic/>
Apr 12 01:50:01 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:50:01 user nova-compute[82184]:   </features>
Apr 12 01:50:01 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:50:01 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:50:01 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:50:01 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:50:01 user nova-compute[82184]:   </clock>
Apr 12 01:50:01 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:50:01 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:50:01 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:50:01 user nova-compute[82184]:   </cpu>
Apr 12 01:50:01 user nova-compute[82184]:   <devices>
Apr 12 01:50:01 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:50:01 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:50:01 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk"/>
Apr 12 01:50:01 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:50:01 user nova-compute[82184]:     </disk>
Apr 12 01:50:01 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:50:01 user nova-compute[82184]:       <mac address="fa:16:3e:79:68:d8"/>
Apr 12 01:50:01 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:01 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:50:01 user nova-compute[82184]:       <target dev="tapf70a5cfd-b9"/>
Apr 12 01:50:01 user nova-compute[82184]:     </interface>
Apr 12 01:50:01 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:50:01 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/console.log" append="off"/>
Apr 12 01:50:01 user nova-compute[82184]:     </serial>
Apr 12 01:50:01 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:50:01 user nova-compute[82184]:     <video>
Apr 12 01:50:01 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:01 user nova-compute[82184]:     </video>
Apr 12 01:50:01 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:50:01 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:50:01 user nova-compute[82184]:     </rng>
Apr 12 01:50:01 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:50:01 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:50:01 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:50:01 user nova-compute[82184]:     </memballoon>
Apr 12 01:50:01 user nova-compute[82184]:   </devices>
Apr 12 01:50:01 user nova-compute[82184]: </domain>
Apr 12 01:50:01 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-494306683',display_name='tempest-DeleteServersTestJSON-server-494306683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-494306683',id=5,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a7713a76bb546d2a348927f18b12eb7',ramdisk_id='',reservation_id='r-9sxho75h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-986135774',owner_user_name='tempest-DeleteServersTestJSON-986135774-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:54Z,user_data=None,user_id='6c503a0141cf4794bf4e6faba59bdba3',uuid=371f55da-306a-4ef9-b04f-7c22e8071e5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "address": "fa:16:3e:79:68:d8", "network": {"id": "0ef60c4f-0414-4002-adfd-b2fd10b1cd53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-791717922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7713a76bb546d2a348927f18b12eb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70a5cfd-b9", "ovs_interfaceid": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Converting VIF {"id": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "address": "fa:16:3e:79:68:d8", "network": {"id": "0ef60c4f-0414-4002-adfd-b2fd10b1cd53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-791717922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7713a76bb546d2a348927f18b12eb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70a5cfd-b9", "ovs_interfaceid": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:68:d8,bridge_name='br-int',has_traffic_filtering=True,id=f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1,network=Network(0ef60c4f-0414-4002-adfd-b2fd10b1cd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70a5cfd-b9') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG os_vif [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:68:d8,bridge_name='br-int',has_traffic_filtering=True,id=f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1,network=Network(0ef60c4f-0414-4002-adfd-b2fd10b1cd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70a5cfd-b9') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf70a5cfd-b9, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf70a5cfd-b9, col_values=(('external_ids', {'iface-id': 'f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:68:d8', 'vm-uuid': '371f55da-306a-4ef9-b04f-7c22e8071e5c'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:50:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:01 user nova-compute[82184]: INFO os_vif [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:68:d8,bridge_name='br-int',has_traffic_filtering=True,id=f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1,network=Network(0ef60c4f-0414-4002-adfd-b2fd10b1cd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70a5cfd-b9')
Apr 12 01:50:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] No VIF found with MAC fa:16:3e:79:68:d8, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-8c809fa5-dca2-4b7a-8ba5-d52d15e40209 req-47ec39f9-8210-4646-9083-a2dcd02ec94d service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Updated VIF entry in instance network info cache for port d776e917-e4e5-4688-b138-ffb1eebbb61f. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-8c809fa5-dca2-4b7a-8ba5-d52d15e40209 req-47ec39f9-8210-4646-9083-a2dcd02ec94d service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Updating instance_info_cache with network_info: [{"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG nova.network.neutron [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updating instance_info_cache with network_info: [{"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c809fa5-dca2-4b7a-8ba5-d52d15e40209 req-47ec39f9-8210-4646-9083-a2dcd02ec94d service nova] Releasing lock "refresh_cache-dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Releasing lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance network_info: |[{"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7ee42332-2c70-4798-8827-cb08e86ca8c6 req-a6d3545d-7492-4621-9e1d-b83b2e887b3a service nova] Acquired lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-7ee42332-2c70-4798-8827-cb08e86ca8c6 req-a6d3545d-7492-4621-9e1d-b83b2e887b3a service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Refreshing network info cache for port ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Start _get_guest_xml network_info=[{"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-7ee42332-2c70-4798-8827-cb08e86ca8c6 req-a6d3545d-7492-4621-9e1d-b83b2e887b3a service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updated VIF entry in instance network info cache for port ec368fc5-6d05-4bab-8460-cf9f1e024195. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-7ee42332-2c70-4798-8827-cb08e86ca8c6 req-a6d3545d-7492-4621-9e1d-b83b2e887b3a service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updating instance_info_cache with network_info: [{"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7ee42332-2c70-4798-8827-cb08e86ca8c6 req-a6d3545d-7492-4621-9e1d-b83b2e887b3a service nova] Releasing lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-8c62d455-bf86-41b8-ba6c-9e0654fcbab9 req-3cba99cc-65da-4c65-82a6-2c3c3092f816 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Received event network-vif-plugged-d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c62d455-bf86-41b8-ba6c-9e0654fcbab9 req-3cba99cc-65da-4c65-82a6-2c3c3092f816 service nova] Acquiring lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c62d455-bf86-41b8-ba6c-9e0654fcbab9 req-3cba99cc-65da-4c65-82a6-2c3c3092f816 service nova] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c62d455-bf86-41b8-ba6c-9e0654fcbab9 req-3cba99cc-65da-4c65-82a6-2c3c3092f816 service nova] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-8c62d455-bf86-41b8-ba6c-9e0654fcbab9 req-3cba99cc-65da-4c65-82a6-2c3c3092f816 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] No waiting events found dispatching network-vif-plugged-d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:05 user nova-compute[82184]: WARNING nova.compute.manager [req-8c62d455-bf86-41b8-ba6c-9e0654fcbab9 req-3cba99cc-65da-4c65-82a6-2c3c3092f816 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Received unexpected event network-vif-plugged-d776e917-e4e5-4688-b138-ffb1eebbb61f for instance with vm_state building and task_state spawning.
Apr 12 01:50:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-1b2e7b1f-0dc0-46a1-b92a-df4d17638c7e req-82eb23be-1b2f-4eca-bd31-dfa18ca0b0ff service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1b2e7b1f-0dc0-46a1-b92a-df4d17638c7e req-82eb23be-1b2f-4eca-bd31-dfa18ca0b0ff service nova] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1b2e7b1f-0dc0-46a1-b92a-df4d17638c7e req-82eb23be-1b2f-4eca-bd31-dfa18ca0b0ff service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1b2e7b1f-0dc0-46a1-b92a-df4d17638c7e req-82eb23be-1b2f-4eca-bd31-dfa18ca0b0ff service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-1b2e7b1f-0dc0-46a1-b92a-df4d17638c7e req-82eb23be-1b2f-4eca-bd31-dfa18ca0b0ff service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] No waiting events found dispatching network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:06 user nova-compute[82184]: WARNING nova.compute.manager [req-1b2e7b1f-0dc0-46a1-b92a-df4d17638c7e req-82eb23be-1b2f-4eca-bd31-dfa18ca0b0ff service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received unexpected event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d for instance with vm_state building and task_state spawning.
Apr 12 01:50:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-96d0650b-695a-4a33-a4c0-843093430217 req-afa969a6-d85d-41c2-828c-604f858a47aa service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-96d0650b-695a-4a33-a4c0-843093430217 req-afa969a6-d85d-41c2-828c-604f858a47aa service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-96d0650b-695a-4a33-a4c0-843093430217 req-afa969a6-d85d-41c2-828c-604f858a47aa service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-96d0650b-695a-4a33-a4c0-843093430217 req-afa969a6-d85d-41c2-828c-604f858a47aa service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-96d0650b-695a-4a33-a4c0-843093430217 req-afa969a6-d85d-41c2-828c-604f858a47aa service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:06 user nova-compute[82184]: WARNING nova.compute.manager [req-96d0650b-695a-4a33-a4c0-843093430217 req-afa969a6-d85d-41c2-828c-604f858a47aa service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state building and task_state spawning.
Apr 12 01:50:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Received event network-vif-plugged-d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] Acquiring lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] No waiting events found dispatching network-vif-plugged-d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:07 user nova-compute[82184]: WARNING nova.compute.manager [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Received unexpected event network-vif-plugged-d776e917-e4e5-4688-b138-ffb1eebbb61f for instance with vm_state building and task_state spawning.
Apr 12 01:50:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:07 user nova-compute[82184]: WARNING nova.compute.manager [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state building and task_state spawning.
Apr 12 01:50:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:07 user nova-compute[82184]: WARNING nova.compute.manager [req-610adcc9-eedc-467e-ba3e-21a6984c88ff req-78930aa9-9a5a-442f-bbf1-c5eff213708a service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state building and task_state spawning.
Apr 12 01:50:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-6babd888-e4e9-43c2-ad11-7bf4f7ff2abe req-49a7ce95-ca9a-4587-aa7a-3c92b9d8ca60 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6babd888-e4e9-43c2-ad11-7bf4f7ff2abe req-49a7ce95-ca9a-4587-aa7a-3c92b9d8ca60 service nova] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6babd888-e4e9-43c2-ad11-7bf4f7ff2abe req-49a7ce95-ca9a-4587-aa7a-3c92b9d8ca60 service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6babd888-e4e9-43c2-ad11-7bf4f7ff2abe req-49a7ce95-ca9a-4587-aa7a-3c92b9d8ca60 service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-6babd888-e4e9-43c2-ad11-7bf4f7ff2abe req-49a7ce95-ca9a-4587-aa7a-3c92b9d8ca60 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] No waiting events found dispatching network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:08 user nova-compute[82184]: WARNING nova.compute.manager [req-6babd888-e4e9-43c2-ad11-7bf4f7ff2abe req-49a7ce95-ca9a-4587-aa7a-3c92b9d8ca60 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received unexpected event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d for instance with vm_state building and task_state spawning.
Apr 12 01:50:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-5906689e-5dd6-47a0-ad53-84860eb26232 req-ab7cba29-1d7b-4b52-96f1-fb4cfa849717 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5906689e-5dd6-47a0-ad53-84860eb26232 req-ab7cba29-1d7b-4b52-96f1-fb4cfa849717 service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5906689e-5dd6-47a0-ad53-84860eb26232 req-ab7cba29-1d7b-4b52-96f1-fb4cfa849717 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5906689e-5dd6-47a0-ad53-84860eb26232 req-ab7cba29-1d7b-4b52-96f1-fb4cfa849717 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-5906689e-5dd6-47a0-ad53-84860eb26232 req-ab7cba29-1d7b-4b52-96f1-fb4cfa849717 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:08 user nova-compute[82184]: WARNING nova.compute.manager [req-5906689e-5dd6-47a0-ad53-84860eb26232 req-ab7cba29-1d7b-4b52-96f1-fb4cfa849717 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state building and task_state spawning.
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264209.494962, dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:09 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] VM Resumed (Lifecycle Event)
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:50:09 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Instance spawned successfully.
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:50:09 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:09 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-682748151',display_name='tempest-AttachVolumeTestJSON-server-682748151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-682748151',id=6,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2NTbVfrYVAmPq/WSiXNxhw73D4U473knUSj3S2SzGG67zJUMcYD7NdTMJnRymKmrJWRxrjStG5itGjTKaX5Cd+wZw4hLfWVikFnVEIrbrRCuVHjjCnBxwGGHScYXLHw==',key_name='tempest-keypair-663896141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-n3kypybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=cb89325c-680a-4413-8e94-4eddfaa79c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.objects.instance [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'pci_devices' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:50:09 user nova-compute[82184]:   <uuid>cb89325c-680a-4413-8e94-4eddfaa79c6b</uuid>
Apr 12 01:50:09 user nova-compute[82184]:   <name>instance-00000006</name>
Apr 12 01:50:09 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:50:09 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:50:09 user nova-compute[82184]:   <metadata>
Apr 12 01:50:09 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:50:09 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:50:09 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeTestJSON-server-682748151</nova:name>
Apr 12 01:50:09 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:50:09</nova:creationTime>
Apr 12 01:50:09 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:50:09 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:50:09 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:50:09 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:50:09 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:50:09 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:50:09 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:50:09 user nova-compute[82184]:       <nova:owner>
Apr 12 01:50:09 user nova-compute[82184]:         <nova:user uuid="d2ca4855c3e9461cb27c88469086d7d8">tempest-AttachVolumeTestJSON-913560355-project-member</nova:user>
Apr 12 01:50:09 user nova-compute[82184]:         <nova:project uuid="c34bd636a2a54b249dca9ce9027ebf4b">tempest-AttachVolumeTestJSON-913560355</nova:project>
Apr 12 01:50:09 user nova-compute[82184]:       </nova:owner>
Apr 12 01:50:09 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:50:09 user nova-compute[82184]:       <nova:ports>
Apr 12 01:50:09 user nova-compute[82184]:         <nova:port uuid="ec368fc5-6d05-4bab-8460-cf9f1e024195">
Apr 12 01:50:09 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 01:50:09 user nova-compute[82184]:         </nova:port>
Apr 12 01:50:09 user nova-compute[82184]:       </nova:ports>
Apr 12 01:50:09 user nova-compute[82184]:     </nova:instance>
Apr 12 01:50:09 user nova-compute[82184]:   </metadata>
Apr 12 01:50:09 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:50:09 user nova-compute[82184]:     <system>
Apr 12 01:50:09 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:50:09 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:50:09 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:50:09 user nova-compute[82184]:       <entry name="serial">cb89325c-680a-4413-8e94-4eddfaa79c6b</entry>
Apr 12 01:50:09 user nova-compute[82184]:       <entry name="uuid">cb89325c-680a-4413-8e94-4eddfaa79c6b</entry>
Apr 12 01:50:09 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:50:09 user nova-compute[82184]:     </system>
Apr 12 01:50:09 user nova-compute[82184]:   </sysinfo>
Apr 12 01:50:09 user nova-compute[82184]:   <os>
Apr 12 01:50:09 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:50:09 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:50:09 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:50:09 user nova-compute[82184]:   </os>
Apr 12 01:50:09 user nova-compute[82184]:   <features>
Apr 12 01:50:09 user nova-compute[82184]:     <acpi/>
Apr 12 01:50:09 user nova-compute[82184]:     <apic/>
Apr 12 01:50:09 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:50:09 user nova-compute[82184]:   </features>
Apr 12 01:50:09 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:50:09 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:50:09 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:50:09 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:50:09 user nova-compute[82184]:   </clock>
Apr 12 01:50:09 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:50:09 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:50:09 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:50:09 user nova-compute[82184]:   </cpu>
Apr 12 01:50:09 user nova-compute[82184]:   <devices>
Apr 12 01:50:09 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:50:09 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:50:09 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk"/>
Apr 12 01:50:09 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:50:09 user nova-compute[82184]:     </disk>
Apr 12 01:50:09 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:50:09 user nova-compute[82184]:       <mac address="fa:16:3e:9d:cb:06"/>
Apr 12 01:50:09 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:09 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:50:09 user nova-compute[82184]:       <target dev="tapec368fc5-6d"/>
Apr 12 01:50:09 user nova-compute[82184]:     </interface>
Apr 12 01:50:09 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:50:09 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/console.log" append="off"/>
Apr 12 01:50:09 user nova-compute[82184]:     </serial>
Apr 12 01:50:09 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:50:09 user nova-compute[82184]:     <video>
Apr 12 01:50:09 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:09 user nova-compute[82184]:     </video>
Apr 12 01:50:09 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:50:09 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:50:09 user nova-compute[82184]:     </rng>
Apr 12 01:50:09 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:50:09 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:50:09 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:50:09 user nova-compute[82184]:     </memballoon>
Apr 12 01:50:09 user nova-compute[82184]:   </devices>
Apr 12 01:50:09 user nova-compute[82184]: </domain>
Apr 12 01:50:09 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-682748151',display_name='tempest-AttachVolumeTestJSON-server-682748151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-682748151',id=6,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2NTbVfrYVAmPq/WSiXNxhw73D4U473knUSj3S2SzGG67zJUMcYD7NdTMJnRymKmrJWRxrjStG5itGjTKaX5Cd+wZw4hLfWVikFnVEIrbrRCuVHjjCnBxwGGHScYXLHw==',key_name='tempest-keypair-663896141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-n3kypybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:49:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=cb89325c-680a-4413-8e94-4eddfaa79c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG os_vif [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec368fc5-6d, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec368fc5-6d, col_values=(('external_ids', {'iface-id': 'ec368fc5-6d05-4bab-8460-cf9f1e024195', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:cb:06', 'vm-uuid': 'cb89325c-680a-4413-8e94-4eddfaa79c6b'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:09 user nova-compute[82184]: INFO os_vif [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d')
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:50:09 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264209.4957378, dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:09 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] VM Started (Lifecycle Event)
Apr 12 01:50:09 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Instance spawned successfully.
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:50:09 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Instance spawned successfully.
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:09 user nova-compute[82184]: INFO nova.compute.manager [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Took 17.54 seconds to spawn the instance on the hypervisor.
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No VIF found with MAC fa:16:3e:9d:cb:06, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:09 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264209.708315, fdbd8add-ac0e-42ce-9b34-5878c6bec208 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:09 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] VM Resumed (Lifecycle Event)
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Received event network-vif-plugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] Acquiring lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] No waiting events found dispatching network-vif-plugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:09 user nova-compute[82184]: WARNING nova.compute.manager [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Received unexpected event network-vif-plugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 for instance with vm_state building and task_state spawning.
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Received event network-vif-plugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] Acquiring lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] No waiting events found dispatching network-vif-plugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:09 user nova-compute[82184]: WARNING nova.compute.manager [req-15f15156-4680-494f-9bef-4578021d5a98 req-c571be4b-81d0-410c-8ed5-a41fb3fb0a5a service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Received unexpected event network-vif-plugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 for instance with vm_state building and task_state spawning.
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:50:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance spawned successfully.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Took 19.03 seconds to build instance.
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Instance spawned successfully.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264209.7110045, fdbd8add-ac0e-42ce-9b34-5878c6bec208 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] VM Started (Lifecycle Event)
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81468de8-3320-46a8-bcdd-4f7f20fbd95b tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.294s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264209.7406461, d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] VM Resumed (Lifecycle Event)
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Took 20.55 seconds to spawn the instance on the hypervisor.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Took 18.55 seconds to spawn the instance on the hypervisor.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Took 16.05 seconds to spawn the instance on the hypervisor.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264209.7419395, d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] VM Started (Lifecycle Event)
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264209.9810605, c712f2db-72cb-4136-a719-56057d82fff6 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] VM Resumed (Lifecycle Event)
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Took 19.97 seconds to build instance.
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264209.9863596, c712f2db-72cb-4136-a719-56057d82fff6 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] VM Started (Lifecycle Event)
Apr 12 01:50:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-480eb4dd-c9a6-426b-a916-341472b0def0 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.162s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Took 19.37 seconds to spawn the instance on the hypervisor.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Took 21.87 seconds to build instance.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-55be52d8-8df5-4d9d-b6d2-3ee663837b40 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.078s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:10 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264210.0002747, 371f55da-306a-4ef9-b04f-7c22e8071e5c => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] VM Resumed (Lifecycle Event)
Apr 12 01:50:10 user nova-compute[82184]: INFO nova.compute.manager [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Took 17.51 seconds to build instance.
Apr 12 01:50:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264210.0005007, 371f55da-306a-4ef9-b04f-7c22e8071e5c => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:11 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] VM Started (Lifecycle Event)
Apr 12 01:50:11 user nova-compute[82184]: INFO nova.compute.manager [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Took 20.42 seconds to build instance.
Apr 12 01:50:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7527f881-3466-43ff-a80d-12488526a26d tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.774s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5108f3d1-83f8-4e4f-b985-01ab8e8070b5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.876s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-2bace5fd-db3c-46a5-afaa-a62790e7541a req-d6a9ce45-2853-4bde-8101-b984dd86ce7c service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2bace5fd-db3c-46a5-afaa-a62790e7541a req-d6a9ce45-2853-4bde-8101-b984dd86ce7c service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2bace5fd-db3c-46a5-afaa-a62790e7541a req-d6a9ce45-2853-4bde-8101-b984dd86ce7c service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2bace5fd-db3c-46a5-afaa-a62790e7541a req-d6a9ce45-2853-4bde-8101-b984dd86ce7c service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-2bace5fd-db3c-46a5-afaa-a62790e7541a req-d6a9ce45-2853-4bde-8101-b984dd86ce7c service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:13 user nova-compute[82184]: WARNING nova.compute.manager [req-2bace5fd-db3c-46a5-afaa-a62790e7541a req-d6a9ce45-2853-4bde-8101-b984dd86ce7c service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state building and task_state spawning.
Apr 12 01:50:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264215.1377833, cb89325c-680a-4413-8e94-4eddfaa79c6b => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:15 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] VM Resumed (Lifecycle Event)
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:50:15 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance spawned successfully.
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:15 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264215.1416256, cb89325c-680a-4413-8e94-4eddfaa79c6b => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:15 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] VM Started (Lifecycle Event)
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:15 user nova-compute[82184]: INFO nova.compute.manager [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Took 18.60 seconds to spawn the instance on the hypervisor.
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:15 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-9f862628-6305-488c-a805-a016c5f1fea7 req-5dc4562f-873f-4edb-9d3e-e9b82b3d2672 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9f862628-6305-488c-a805-a016c5f1fea7 req-5dc4562f-873f-4edb-9d3e-e9b82b3d2672 service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9f862628-6305-488c-a805-a016c5f1fea7 req-5dc4562f-873f-4edb-9d3e-e9b82b3d2672 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9f862628-6305-488c-a805-a016c5f1fea7 req-5dc4562f-873f-4edb-9d3e-e9b82b3d2672 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-9f862628-6305-488c-a805-a016c5f1fea7 req-5dc4562f-873f-4edb-9d3e-e9b82b3d2672 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:15 user nova-compute[82184]: WARNING nova.compute.manager [req-9f862628-6305-488c-a805-a016c5f1fea7 req-5dc4562f-873f-4edb-9d3e-e9b82b3d2672 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state building and task_state spawning.
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:50:15 user nova-compute[82184]: INFO nova.compute.manager [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Took 19.60 seconds to build instance.
Apr 12 01:50:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faba2212-4861-40c4-8865-356c433f227e tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.742s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:50:15 user nova-compute[82184]: INFO nova.compute.claims [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Claim successful on node user
Apr 12 01:50:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:16 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.279s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG nova.network.neutron [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:50:17 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 12 01:50:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG nova.policy [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e400a3359c844c449445cfba08ef7a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742d0477bb3b464e8d98d42a85c330e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:50:17 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Creating image(s)
Apr 12 01:50:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "/opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "/opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d.part --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d.part --force-share --output=json" returned: 0 in 0.227s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:18 user nova-compute[82184]: DEBUG nova.virt.images [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] aaf0837b-b109-4309-87a6-5a6729f0eccc was qcow2, converting to raw {{(pid=82184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 01:50:18 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 01:50:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d.part /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d.converted {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d.part /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d.converted" returned: 0 in 0.425s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d.converted --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d.converted --force-share --output=json" returned: 0 in 0.240s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.445s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d --force-share --output=json" returned: 0 in 0.351s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d --force-share --output=json" returned: 0 in 0.224s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d,backing_fmt=raw /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG nova.network.neutron [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Successfully created port: 38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d,backing_fmt=raw /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk 1073741824" returned: 0 in 0.102s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d --force-share --output=json" returned: 0 in 0.335s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Cannot resize image /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG nova.objects.instance [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lazy-loading 'migration_context' on Instance uuid f2eedf78-0fd6-4cc1-8efd-50958e07fde6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Ensure instance console log exists: /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:50:20 user nova-compute[82184]: INFO nova.compute.claims [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Claim successful on node user
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.830s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Successfully updated port: 38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "refresh_cache-f2eedf78-0fd6-4cc1-8efd-50958e07fde6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquired lock "refresh_cache-f2eedf78-0fd6-4cc1-8efd-50958e07fde6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:50:21 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.policy [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeb7fd40946e43dc860d63bb8958d633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dd135bd60941dbb68b3e677c4878e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-f3c562a2-9c71-43ce-b074-63fcf5e6e3a4 req-4f26eef5-73df-46af-8307-d3c2a2da2fb5 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received event network-changed-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-f3c562a2-9c71-43ce-b074-63fcf5e6e3a4 req-4f26eef5-73df-46af-8307-d3c2a2da2fb5 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Refreshing instance network info cache due to event network-changed-38b808a5-094e-480a-b52f-d36407148227. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f3c562a2-9c71-43ce-b074-63fcf5e6e3a4 req-4f26eef5-73df-46af-8307-d3c2a2da2fb5 service nova] Acquiring lock "refresh_cache-f2eedf78-0fd6-4cc1-8efd-50958e07fde6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Updating instance_info_cache with network_info: [{"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Releasing lock "refresh_cache-f2eedf78-0fd6-4cc1-8efd-50958e07fde6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Instance network_info: |[{"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f3c562a2-9c71-43ce-b074-63fcf5e6e3a4 req-4f26eef5-73df-46af-8307-d3c2a2da2fb5 service nova] Acquired lock "refresh_cache-f2eedf78-0fd6-4cc1-8efd-50958e07fde6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.network.neutron [req-f3c562a2-9c71-43ce-b074-63fcf5e6e3a4 req-4f26eef5-73df-46af-8307-d3c2a2da2fb5 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Refreshing network info cache for port 38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Start _get_guest_xml network_info=[{"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:50:06Z,direct_url=<?>,disk_format='qcow2',id=aaf0837b-b109-4309-87a6-5a6729f0eccc,min_disk=0,min_ram=0,name='',owner='63e3557b85e74b24bf8d26a46987974e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:50:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'scsi', 'encryption_options': None, 'device_name': '/dev/sda', 'encrypted': False, 'device_type': 'disk', 'image_id': 'aaf0837b-b109-4309-87a6-5a6729f0eccc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:50:22 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:22 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:50:06Z,direct_url=<?>,disk_format='qcow2',id=aaf0837b-b109-4309-87a6-5a6729f0eccc,min_disk=0,min_ram=0,name='',owner='63e3557b85e74b24bf8d26a46987974e',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:50:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1735119552',display_name='tempest-AttachSCSIVolumeTestJSON-server-1735119552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1735119552',id=7,image_ref='aaf0837b-b109-4309-87a6-5a6729f0eccc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoBx7IwA26nr+H9WbInCKQvzt885MvXO4T7OFAxKtTB1Y+/K8rC2POLNWs9WxsvQqtRVrXppKseGE6lFkO0s+3jTpEjBu+bRewGqCxddqqCMhq2Zh6JTma7wnriFenAJw==',key_name='tempest-keypair-38328491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='742d0477bb3b464e8d98d42a85c330e7',ramdisk_id='',reservation_id='r-9oa0e0ek',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aaf0837b-b109-4309-87a6-5a6729f0eccc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1163480770',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1163480770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e400a3359c844c449445cfba08ef7a7b',uuid=f2eedf78-0fd6-4cc1-8efd-50958e07fde6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Converting VIF {"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:35:b7,bridge_name='br-int',has_traffic_filtering=True,id=38b808a5-094e-480a-b52f-d36407148227,network=Network(e5e461dd-9a8b-4f2a-90ec-34fb659152b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b808a5-09') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.objects.instance [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lazy-loading 'pci_devices' on Instance uuid f2eedf78-0fd6-4cc1-8efd-50958e07fde6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:50:22 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Creating image(s)
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "/opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "/opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:50:22 user nova-compute[82184]:   <uuid>f2eedf78-0fd6-4cc1-8efd-50958e07fde6</uuid>
Apr 12 01:50:22 user nova-compute[82184]:   <name>instance-00000007</name>
Apr 12 01:50:22 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:50:22 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:50:22 user nova-compute[82184]:   <metadata>
Apr 12 01:50:22 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:50:22 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:50:22 user nova-compute[82184]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1735119552</nova:name>
Apr 12 01:50:22 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:50:22</nova:creationTime>
Apr 12 01:50:22 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:50:22 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:50:22 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:50:22 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:50:22 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:50:22 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:50:22 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:50:22 user nova-compute[82184]:       <nova:owner>
Apr 12 01:50:22 user nova-compute[82184]:         <nova:user uuid="e400a3359c844c449445cfba08ef7a7b">tempest-AttachSCSIVolumeTestJSON-1163480770-project-member</nova:user>
Apr 12 01:50:22 user nova-compute[82184]:         <nova:project uuid="742d0477bb3b464e8d98d42a85c330e7">tempest-AttachSCSIVolumeTestJSON-1163480770</nova:project>
Apr 12 01:50:22 user nova-compute[82184]:       </nova:owner>
Apr 12 01:50:22 user nova-compute[82184]:       <nova:root type="image" uuid="aaf0837b-b109-4309-87a6-5a6729f0eccc"/>
Apr 12 01:50:22 user nova-compute[82184]:       <nova:ports>
Apr 12 01:50:22 user nova-compute[82184]:         <nova:port uuid="38b808a5-094e-480a-b52f-d36407148227">
Apr 12 01:50:22 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 01:50:22 user nova-compute[82184]:         </nova:port>
Apr 12 01:50:22 user nova-compute[82184]:       </nova:ports>
Apr 12 01:50:22 user nova-compute[82184]:     </nova:instance>
Apr 12 01:50:22 user nova-compute[82184]:   </metadata>
Apr 12 01:50:22 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:50:22 user nova-compute[82184]:     <system>
Apr 12 01:50:22 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:50:22 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:50:22 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:50:22 user nova-compute[82184]:       <entry name="serial">f2eedf78-0fd6-4cc1-8efd-50958e07fde6</entry>
Apr 12 01:50:22 user nova-compute[82184]:       <entry name="uuid">f2eedf78-0fd6-4cc1-8efd-50958e07fde6</entry>
Apr 12 01:50:22 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:50:22 user nova-compute[82184]:     </system>
Apr 12 01:50:22 user nova-compute[82184]:   </sysinfo>
Apr 12 01:50:22 user nova-compute[82184]:   <os>
Apr 12 01:50:22 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:50:22 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:50:22 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:50:22 user nova-compute[82184]:   </os>
Apr 12 01:50:22 user nova-compute[82184]:   <features>
Apr 12 01:50:22 user nova-compute[82184]:     <acpi/>
Apr 12 01:50:22 user nova-compute[82184]:     <apic/>
Apr 12 01:50:22 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:50:22 user nova-compute[82184]:   </features>
Apr 12 01:50:22 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:50:22 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:50:22 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:50:22 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:50:22 user nova-compute[82184]:   </clock>
Apr 12 01:50:22 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:50:22 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:50:22 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:50:22 user nova-compute[82184]:   </cpu>
Apr 12 01:50:22 user nova-compute[82184]:   <devices>
Apr 12 01:50:22 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:50:22 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:50:22 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk"/>
Apr 12 01:50:22 user nova-compute[82184]:       <target dev="sda" bus="scsi"/>
Apr 12 01:50:22 user nova-compute[82184]:       <address type="drive" controller="0" unit="0"/>
Apr 12 01:50:22 user nova-compute[82184]:     </disk>
Apr 12 01:50:22 user nova-compute[82184]:     <disk type="file" device="cdrom">
Apr 12 01:50:22 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 01:50:22 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk.config"/>
Apr 12 01:50:22 user nova-compute[82184]:       <target dev="sdb" bus="scsi"/>
Apr 12 01:50:22 user nova-compute[82184]:       <address type="drive" controller="0" unit="1"/>
Apr 12 01:50:22 user nova-compute[82184]:     </disk>
Apr 12 01:50:22 user nova-compute[82184]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 12 01:50:22 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:50:22 user nova-compute[82184]:       <mac address="fa:16:3e:5e:35:b7"/>
Apr 12 01:50:22 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:22 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:50:22 user nova-compute[82184]:       <target dev="tap38b808a5-09"/>
Apr 12 01:50:22 user nova-compute[82184]:     </interface>
Apr 12 01:50:22 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:50:22 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/console.log" append="off"/>
Apr 12 01:50:22 user nova-compute[82184]:     </serial>
Apr 12 01:50:22 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:50:22 user nova-compute[82184]:     <video>
Apr 12 01:50:22 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:22 user nova-compute[82184]:     </video>
Apr 12 01:50:22 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:50:22 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:50:22 user nova-compute[82184]:     </rng>
Apr 12 01:50:22 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:50:22 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:50:22 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:50:22 user nova-compute[82184]:     </memballoon>
Apr 12 01:50:22 user nova-compute[82184]:   </devices>
Apr 12 01:50:22 user nova-compute[82184]: </domain>
Apr 12 01:50:22 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1735119552',display_name='tempest-AttachSCSIVolumeTestJSON-server-1735119552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1735119552',id=7,image_ref='aaf0837b-b109-4309-87a6-5a6729f0eccc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoBx7IwA26nr+H9WbInCKQvzt885MvXO4T7OFAxKtTB1Y+/K8rC2POLNWs9WxsvQqtRVrXppKseGE6lFkO0s+3jTpEjBu+bRewGqCxddqqCMhq2Zh6JTma7wnriFenAJw==',key_name='tempest-keypair-38328491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='742d0477bb3b464e8d98d42a85c330e7',ramdisk_id='',reservation_id='r-9oa0e0ek',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aaf0837b-b109-4309-87a6-5a6729f0eccc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1163480770',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1163480770-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e400a3359c844c449445cfba08ef7a7b',uuid=f2eedf78-0fd6-4cc1-8efd-50958e07fde6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Converting VIF {"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:35:b7,bridge_name='br-int',has_traffic_filtering=True,id=38b808a5-094e-480a-b52f-d36407148227,network=Network(e5e461dd-9a8b-4f2a-90ec-34fb659152b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b808a5-09') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG os_vif [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:35:b7,bridge_name='br-int',has_traffic_filtering=True,id=38b808a5-094e-480a-b52f-d36407148227,network=Network(e5e461dd-9a8b-4f2a-90ec-34fb659152b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b808a5-09') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38b808a5-09, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38b808a5-09, col_values=(('external_ids', {'iface-id': '38b808a5-094e-480a-b52f-d36407148227', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:35:b7', 'vm-uuid': 'f2eedf78-0fd6-4cc1-8efd-50958e07fde6'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:22 user nova-compute[82184]: INFO os_vif [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:35:b7,bridge_name='br-int',has_traffic_filtering=True,id=38b808a5-094e-480a-b52f-d36407148227,network=Network(e5e461dd-9a8b-4f2a-90ec-34fb659152b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b808a5-09')
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] No BDM found with device name sda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] No VIF found with MAC fa:16:3e:5e:35:b7, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:50:22 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Using config drive
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.366s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.205s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:22 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Creating config drive at /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk.config
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp34bh7hyt {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk 1073741824" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp34bh7hyt" returned: 0 in 0.093s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:50:22 user nova-compute[82184]: INFO nova.compute.claims [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Claim successful on node user
Apr 12 01:50:23 user nova-compute[82184]: DEBUG nova.network.neutron [req-f3c562a2-9c71-43ce-b074-63fcf5e6e3a4 req-4f26eef5-73df-46af-8307-d3c2a2da2fb5 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Updated VIF entry in instance network info cache for port 38b808a5-094e-480a-b52f-d36407148227. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG nova.network.neutron [req-f3c562a2-9c71-43ce-b074-63fcf5e6e3a4 req-4f26eef5-73df-46af-8307-d3c2a2da2fb5 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Updating instance_info_cache with network_info: [{"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f3c562a2-9c71-43ce-b074-63fcf5e6e3a4 req-4f26eef5-73df-46af-8307-d3c2a2da2fb5 service nova] Releasing lock "refresh_cache-f2eedf78-0fd6-4cc1-8efd-50958e07fde6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.257s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Successfully created port: f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Cannot resize image /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lazy-loading 'migration_context' on Instance uuid 2dbe5433-e1e5-4b85-a0f7-904c3b784335 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Ensure instance console log exists: /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.013s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:50:23 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.276s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:50:24 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:50:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG nova.policy [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '592f78cbcf7046e68bcf6c88e039a9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1f516270354a82995f75c4c149dad2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:50:24 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Creating image(s)
Apr 12 01:50:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "/opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "/opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "/opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Successfully updated port: f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.210s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquired lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-c68d0b5c-a098-49d8-8794-0caca78dadb1 req-950836db-6114-4e85-bad0-8c35898b7493 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received event network-changed-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-c68d0b5c-a098-49d8-8794-0caca78dadb1 req-950836db-6114-4e85-bad0-8c35898b7493 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Refreshing instance network info cache due to event network-changed-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c68d0b5c-a098-49d8-8794-0caca78dadb1 req-950836db-6114-4e85-bad0-8c35898b7493 service nova] Acquiring lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.213s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk 1073741824" returned: 0 in 0.163s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.388s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Successfully created port: 0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.329s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-c06862e4-1bd8-4930-9621-c56b6a7a3923 req-b445c10b-1e4d-4e07-a8a5-50dcdae09dc8 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received event network-vif-plugged-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c06862e4-1bd8-4930-9621-c56b6a7a3923 req-b445c10b-1e4d-4e07-a8a5-50dcdae09dc8 service nova] Acquiring lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c06862e4-1bd8-4930-9621-c56b6a7a3923 req-b445c10b-1e4d-4e07-a8a5-50dcdae09dc8 service nova] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c06862e4-1bd8-4930-9621-c56b6a7a3923 req-b445c10b-1e4d-4e07-a8a5-50dcdae09dc8 service nova] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-c06862e4-1bd8-4930-9621-c56b6a7a3923 req-b445c10b-1e4d-4e07-a8a5-50dcdae09dc8 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] No waiting events found dispatching network-vif-plugged-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:25 user nova-compute[82184]: WARNING nova.compute.manager [req-c06862e4-1bd8-4930-9621-c56b6a7a3923 req-b445c10b-1e4d-4e07-a8a5-50dcdae09dc8 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received unexpected event network-vif-plugged-38b808a5-094e-480a-b52f-d36407148227 for instance with vm_state building and task_state spawning.
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Cannot resize image /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.objects.instance [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lazy-loading 'migration_context' on Instance uuid 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Ensure instance console log exists: /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Updating instance_info_cache with network_info: [{"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Releasing lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Instance network_info: |[{"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c68d0b5c-a098-49d8-8794-0caca78dadb1 req-950836db-6114-4e85-bad0-8c35898b7493 service nova] Acquired lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.network.neutron [req-c68d0b5c-a098-49d8-8794-0caca78dadb1 req-950836db-6114-4e85-bad0-8c35898b7493 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Refreshing network info cache for port f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Start _get_guest_xml network_info=[{"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:26 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:26 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1833946083',display_name='tempest-VolumesAdminNegativeTest-server-1833946083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1833946083',id=8,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhtyZheVbYlLeUhN71vEcEpIuCfTBPYbfrrTYkKIj9EYz55uOf6GTaC6L9Qt5AUB8U6/UJe/T4rJ4Zr50Pm9jh0coWiuaA7ovp73w+1OnKciWJB+jFAJEIEOPz+MR+bw==',key_name='tempest-keypair-599771826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0dd135bd60941dbb68b3e677c4878e9',ramdisk_id='',reservation_id='r-tyw06dt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-312412096',owner_user_name='tempest-VolumesAdminNegativeTest-312412096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb7fd40946e43dc860d63bb8958d633',uuid=2dbe5433-e1e5-4b85-a0f7-904c3b784335,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converting VIF {"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:23:a5,bridge_name='br-int',has_traffic_filtering=True,id=f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0adec2f-3e') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dbe5433-e1e5-4b85-a0f7-904c3b784335 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:50:26 user nova-compute[82184]:   <uuid>2dbe5433-e1e5-4b85-a0f7-904c3b784335</uuid>
Apr 12 01:50:26 user nova-compute[82184]:   <name>instance-00000008</name>
Apr 12 01:50:26 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:50:26 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:50:26 user nova-compute[82184]:   <metadata>
Apr 12 01:50:26 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:50:26 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:50:26 user nova-compute[82184]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1833946083</nova:name>
Apr 12 01:50:26 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:50:26</nova:creationTime>
Apr 12 01:50:26 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:50:26 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:50:26 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:50:26 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:50:26 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:50:26 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:50:26 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:50:26 user nova-compute[82184]:       <nova:owner>
Apr 12 01:50:26 user nova-compute[82184]:         <nova:user uuid="aeb7fd40946e43dc860d63bb8958d633">tempest-VolumesAdminNegativeTest-312412096-project-member</nova:user>
Apr 12 01:50:26 user nova-compute[82184]:         <nova:project uuid="d0dd135bd60941dbb68b3e677c4878e9">tempest-VolumesAdminNegativeTest-312412096</nova:project>
Apr 12 01:50:26 user nova-compute[82184]:       </nova:owner>
Apr 12 01:50:26 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:50:26 user nova-compute[82184]:       <nova:ports>
Apr 12 01:50:26 user nova-compute[82184]:         <nova:port uuid="f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c">
Apr 12 01:50:26 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 01:50:26 user nova-compute[82184]:         </nova:port>
Apr 12 01:50:26 user nova-compute[82184]:       </nova:ports>
Apr 12 01:50:26 user nova-compute[82184]:     </nova:instance>
Apr 12 01:50:26 user nova-compute[82184]:   </metadata>
Apr 12 01:50:26 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:50:26 user nova-compute[82184]:     <system>
Apr 12 01:50:26 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:50:26 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:50:26 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:50:26 user nova-compute[82184]:       <entry name="serial">2dbe5433-e1e5-4b85-a0f7-904c3b784335</entry>
Apr 12 01:50:26 user nova-compute[82184]:       <entry name="uuid">2dbe5433-e1e5-4b85-a0f7-904c3b784335</entry>
Apr 12 01:50:26 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:50:26 user nova-compute[82184]:     </system>
Apr 12 01:50:26 user nova-compute[82184]:   </sysinfo>
Apr 12 01:50:26 user nova-compute[82184]:   <os>
Apr 12 01:50:26 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:50:26 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:50:26 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:50:26 user nova-compute[82184]:   </os>
Apr 12 01:50:26 user nova-compute[82184]:   <features>
Apr 12 01:50:26 user nova-compute[82184]:     <acpi/>
Apr 12 01:50:26 user nova-compute[82184]:     <apic/>
Apr 12 01:50:26 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:50:26 user nova-compute[82184]:   </features>
Apr 12 01:50:26 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:50:26 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:50:26 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:50:26 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:50:26 user nova-compute[82184]:   </clock>
Apr 12 01:50:26 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:50:26 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:50:26 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:50:26 user nova-compute[82184]:   </cpu>
Apr 12 01:50:26 user nova-compute[82184]:   <devices>
Apr 12 01:50:26 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:50:26 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:50:26 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk"/>
Apr 12 01:50:26 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:50:26 user nova-compute[82184]:     </disk>
Apr 12 01:50:26 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:50:26 user nova-compute[82184]:       <mac address="fa:16:3e:fd:23:a5"/>
Apr 12 01:50:26 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:26 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:50:26 user nova-compute[82184]:       <target dev="tapf0adec2f-3e"/>
Apr 12 01:50:26 user nova-compute[82184]:     </interface>
Apr 12 01:50:26 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:50:26 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/console.log" append="off"/>
Apr 12 01:50:26 user nova-compute[82184]:     </serial>
Apr 12 01:50:26 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:50:26 user nova-compute[82184]:     <video>
Apr 12 01:50:26 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:26 user nova-compute[82184]:     </video>
Apr 12 01:50:26 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:50:26 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:50:26 user nova-compute[82184]:     </rng>
Apr 12 01:50:26 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:50:26 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:50:26 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:50:26 user nova-compute[82184]:     </memballoon>
Apr 12 01:50:26 user nova-compute[82184]:   </devices>
Apr 12 01:50:26 user nova-compute[82184]: </domain>
Apr 12 01:50:26 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1833946083',display_name='tempest-VolumesAdminNegativeTest-server-1833946083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1833946083',id=8,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhtyZheVbYlLeUhN71vEcEpIuCfTBPYbfrrTYkKIj9EYz55uOf6GTaC6L9Qt5AUB8U6/UJe/T4rJ4Zr50Pm9jh0coWiuaA7ovp73w+1OnKciWJB+jFAJEIEOPz+MR+bw==',key_name='tempest-keypair-599771826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0dd135bd60941dbb68b3e677c4878e9',ramdisk_id='',reservation_id='r-tyw06dt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-312412096',owner_user_name='tempest-VolumesAdminNegativeTest-312412096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb7fd40946e43dc860d63bb8958d633',uuid=2dbe5433-e1e5-4b85-a0f7-904c3b784335,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converting VIF {"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:23:a5,bridge_name='br-int',has_traffic_filtering=True,id=f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0adec2f-3e') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG os_vif [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:23:a5,bridge_name='br-int',has_traffic_filtering=True,id=f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0adec2f-3e') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0adec2f-3e, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0adec2f-3e, col_values=(('external_ids', {'iface-id': 'f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:23:a5', 'vm-uuid': '2dbe5433-e1e5-4b85-a0f7-904c3b784335'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:26 user nova-compute[82184]: INFO os_vif [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:23:a5,bridge_name='br-int',has_traffic_filtering=True,id=f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0adec2f-3e')
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:50:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] No VIF found with MAC fa:16:3e:fd:23:a5, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Successfully updated port: 0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "refresh_cache-34cbdbd9-16ac-4cbc-be28-c88b7c23de02" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquired lock "refresh_cache-34cbdbd9-16ac-4cbc-be28-c88b7c23de02" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-043f42b2-db01-4cda-abd8-8f9105141db9 req-97e8f402-1ad0-459f-9534-fba519613125 service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received event network-changed-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-043f42b2-db01-4cda-abd8-8f9105141db9 req-97e8f402-1ad0-459f-9534-fba519613125 service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Refreshing instance network info cache due to event network-changed-0afbc2d8-20bd-4f40-b45b-53bad28276d4. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-043f42b2-db01-4cda-abd8-8f9105141db9 req-97e8f402-1ad0-459f-9534-fba519613125 service nova] Acquiring lock "refresh_cache-34cbdbd9-16ac-4cbc-be28-c88b7c23de02" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.neutron [req-c68d0b5c-a098-49d8-8794-0caca78dadb1 req-950836db-6114-4e85-bad0-8c35898b7493 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Updated VIF entry in instance network info cache for port f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.neutron [req-c68d0b5c-a098-49d8-8794-0caca78dadb1 req-950836db-6114-4e85-bad0-8c35898b7493 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Updating instance_info_cache with network_info: [{"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c68d0b5c-a098-49d8-8794-0caca78dadb1 req-950836db-6114-4e85-bad0-8c35898b7493 service nova] Releasing lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Updating instance_info_cache with network_info: [{"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Releasing lock "refresh_cache-34cbdbd9-16ac-4cbc-be28-c88b7c23de02" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Instance network_info: |[{"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-043f42b2-db01-4cda-abd8-8f9105141db9 req-97e8f402-1ad0-459f-9534-fba519613125 service nova] Acquired lock "refresh_cache-34cbdbd9-16ac-4cbc-be28-c88b7c23de02" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.neutron [req-043f42b2-db01-4cda-abd8-8f9105141db9 req-97e8f402-1ad0-459f-9534-fba519613125 service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Refreshing network info cache for port 0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Start _get_guest_xml network_info=[{"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:50:27 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:27 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-74378898',display_name='tempest-TestVolumeSwap-server-74378898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-74378898',id=9,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW4t6M942/LHh6daB7qePEWtiWAJ7b1N9u1/DPWtDalmVzTtTt8SSDAJEDRAeJhrXKOzi8MtjgYWJTbhnxcGIllhlDsuyE7LR5HijyXxbU86EQHerBjvbSSrdtGqPatAQ==',key_name='tempest-keypair-2091713473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1f516270354a82995f75c4c149dad2',ramdisk_id='',reservation_id='r-jblj099o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-706858033',owner_user_name='tempest-TestVolumeSwap-706858033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='592f78cbcf7046e68bcf6c88e039a9be',uuid=34cbdbd9-16ac-4cbc-be28-c88b7c23de02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Converting VIF {"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=0afbc2d8-20bd-4f40-b45b-53bad28276d4,network=Network(409e7f9e-7aa8-44e0-8d4f-6582d339e7c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afbc2d8-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.objects.instance [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lazy-loading 'pci_devices' on Instance uuid 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:50:27 user nova-compute[82184]:   <uuid>34cbdbd9-16ac-4cbc-be28-c88b7c23de02</uuid>
Apr 12 01:50:27 user nova-compute[82184]:   <name>instance-00000009</name>
Apr 12 01:50:27 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:50:27 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:50:27 user nova-compute[82184]:   <metadata>
Apr 12 01:50:27 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:50:27 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:50:27 user nova-compute[82184]:       <nova:name>tempest-TestVolumeSwap-server-74378898</nova:name>
Apr 12 01:50:27 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:50:27</nova:creationTime>
Apr 12 01:50:27 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:50:27 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:50:27 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:50:27 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:50:27 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:50:27 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:50:27 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:50:27 user nova-compute[82184]:       <nova:owner>
Apr 12 01:50:27 user nova-compute[82184]:         <nova:user uuid="592f78cbcf7046e68bcf6c88e039a9be">tempest-TestVolumeSwap-706858033-project-member</nova:user>
Apr 12 01:50:27 user nova-compute[82184]:         <nova:project uuid="3a1f516270354a82995f75c4c149dad2">tempest-TestVolumeSwap-706858033</nova:project>
Apr 12 01:50:27 user nova-compute[82184]:       </nova:owner>
Apr 12 01:50:27 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:50:27 user nova-compute[82184]:       <nova:ports>
Apr 12 01:50:27 user nova-compute[82184]:         <nova:port uuid="0afbc2d8-20bd-4f40-b45b-53bad28276d4">
Apr 12 01:50:27 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 01:50:27 user nova-compute[82184]:         </nova:port>
Apr 12 01:50:27 user nova-compute[82184]:       </nova:ports>
Apr 12 01:50:27 user nova-compute[82184]:     </nova:instance>
Apr 12 01:50:27 user nova-compute[82184]:   </metadata>
Apr 12 01:50:27 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:50:27 user nova-compute[82184]:     <system>
Apr 12 01:50:27 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:50:27 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:50:27 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:50:27 user nova-compute[82184]:       <entry name="serial">34cbdbd9-16ac-4cbc-be28-c88b7c23de02</entry>
Apr 12 01:50:27 user nova-compute[82184]:       <entry name="uuid">34cbdbd9-16ac-4cbc-be28-c88b7c23de02</entry>
Apr 12 01:50:27 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:50:27 user nova-compute[82184]:     </system>
Apr 12 01:50:27 user nova-compute[82184]:   </sysinfo>
Apr 12 01:50:27 user nova-compute[82184]:   <os>
Apr 12 01:50:27 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:50:27 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:50:27 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:50:27 user nova-compute[82184]:   </os>
Apr 12 01:50:27 user nova-compute[82184]:   <features>
Apr 12 01:50:27 user nova-compute[82184]:     <acpi/>
Apr 12 01:50:27 user nova-compute[82184]:     <apic/>
Apr 12 01:50:27 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:50:27 user nova-compute[82184]:   </features>
Apr 12 01:50:27 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:50:27 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:50:27 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:50:27 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:50:27 user nova-compute[82184]:   </clock>
Apr 12 01:50:27 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:50:27 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:50:27 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:50:27 user nova-compute[82184]:   </cpu>
Apr 12 01:50:27 user nova-compute[82184]:   <devices>
Apr 12 01:50:27 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:50:27 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:50:27 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk"/>
Apr 12 01:50:27 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:50:27 user nova-compute[82184]:     </disk>
Apr 12 01:50:27 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:50:27 user nova-compute[82184]:       <mac address="fa:16:3e:ea:a4:9a"/>
Apr 12 01:50:27 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:27 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:50:27 user nova-compute[82184]:       <target dev="tap0afbc2d8-20"/>
Apr 12 01:50:27 user nova-compute[82184]:     </interface>
Apr 12 01:50:27 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:50:27 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/console.log" append="off"/>
Apr 12 01:50:27 user nova-compute[82184]:     </serial>
Apr 12 01:50:27 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:50:27 user nova-compute[82184]:     <video>
Apr 12 01:50:27 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:50:27 user nova-compute[82184]:     </video>
Apr 12 01:50:27 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:50:27 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:50:27 user nova-compute[82184]:     </rng>
Apr 12 01:50:27 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:50:27 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:50:27 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:50:27 user nova-compute[82184]:     </memballoon>
Apr 12 01:50:27 user nova-compute[82184]:   </devices>
Apr 12 01:50:27 user nova-compute[82184]: </domain>
Apr 12 01:50:27 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-74378898',display_name='tempest-TestVolumeSwap-server-74378898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-74378898',id=9,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW4t6M942/LHh6daB7qePEWtiWAJ7b1N9u1/DPWtDalmVzTtTt8SSDAJEDRAeJhrXKOzi8MtjgYWJTbhnxcGIllhlDsuyE7LR5HijyXxbU86EQHerBjvbSSrdtGqPatAQ==',key_name='tempest-keypair-2091713473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1f516270354a82995f75c4c149dad2',ramdisk_id='',reservation_id='r-jblj099o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-706858033',owner_user_name='tempest-TestVolumeSwap-706858033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='592f78cbcf7046e68bcf6c88e039a9be',uuid=34cbdbd9-16ac-4cbc-be28-c88b7c23de02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Converting VIF {"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=0afbc2d8-20bd-4f40-b45b-53bad28276d4,network=Network(409e7f9e-7aa8-44e0-8d4f-6582d339e7c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afbc2d8-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG os_vif [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=0afbc2d8-20bd-4f40-b45b-53bad28276d4,network=Network(409e7f9e-7aa8-44e0-8d4f-6582d339e7c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afbc2d8-20') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0afbc2d8-20, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0afbc2d8-20, col_values=(('external_ids', {'iface-id': '0afbc2d8-20bd-4f40-b45b-53bad28276d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:a4:9a', 'vm-uuid': '34cbdbd9-16ac-4cbc-be28-c88b7c23de02'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:27 user nova-compute[82184]: INFO os_vif [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=0afbc2d8-20bd-4f40-b45b-53bad28276d4,network=Network(409e7f9e-7aa8-44e0-8d4f-6582d339e7c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afbc2d8-20')
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] No VIF found with MAC fa:16:3e:ea:a4:9a, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-7f3709cd-813e-48a1-9246-11a62f850b79 req-876697ca-be49-47c6-9be3-e1ca1767f513 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received event network-vif-plugged-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7f3709cd-813e-48a1-9246-11a62f850b79 req-876697ca-be49-47c6-9be3-e1ca1767f513 service nova] Acquiring lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7f3709cd-813e-48a1-9246-11a62f850b79 req-876697ca-be49-47c6-9be3-e1ca1767f513 service nova] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7f3709cd-813e-48a1-9246-11a62f850b79 req-876697ca-be49-47c6-9be3-e1ca1767f513 service nova] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-7f3709cd-813e-48a1-9246-11a62f850b79 req-876697ca-be49-47c6-9be3-e1ca1767f513 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] No waiting events found dispatching network-vif-plugged-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:27 user nova-compute[82184]: WARNING nova.compute.manager [req-7f3709cd-813e-48a1-9246-11a62f850b79 req-876697ca-be49-47c6-9be3-e1ca1767f513 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received unexpected event network-vif-plugged-38b808a5-094e-480a-b52f-d36407148227 for instance with vm_state building and task_state spawning.
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264228.2185433, f2eedf78-0fd6-4cc1-8efd-50958e07fde6 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:28 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] VM Resumed (Lifecycle Event)
Apr 12 01:50:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:28 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Instance spawned successfully.
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:28 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264228.2438943, f2eedf78-0fd6-4cc1-8efd-50958e07fde6 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:28 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] VM Started (Lifecycle Event)
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:28 user nova-compute[82184]: INFO nova.compute.manager [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Took 10.78 seconds to spawn the instance on the hypervisor.
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:28 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.network.neutron [req-043f42b2-db01-4cda-abd8-8f9105141db9 req-97e8f402-1ad0-459f-9534-fba519613125 service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Updated VIF entry in instance network info cache for port 0afbc2d8-20bd-4f40-b45b-53bad28276d4. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG nova.network.neutron [req-043f42b2-db01-4cda-abd8-8f9105141db9 req-97e8f402-1ad0-459f-9534-fba519613125 service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Updating instance_info_cache with network_info: [{"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-043f42b2-db01-4cda-abd8-8f9105141db9 req-97e8f402-1ad0-459f-9534-fba519613125 service nova] Releasing lock "refresh_cache-34cbdbd9-16ac-4cbc-be28-c88b7c23de02" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:28 user nova-compute[82184]: INFO nova.compute.manager [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Took 12.94 seconds to build instance.
Apr 12 01:50:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-795cfe4d-3e89-4b6e-9f54-68b653d3daa0 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.210s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received event network-vif-plugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] Acquiring lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] No waiting events found dispatching network-vif-plugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:30 user nova-compute[82184]: WARNING nova.compute.manager [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received unexpected event network-vif-plugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c for instance with vm_state building and task_state spawning.
Apr 12 01:50:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received event network-vif-plugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] Acquiring lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] No waiting events found dispatching network-vif-plugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:30 user nova-compute[82184]: WARNING nova.compute.manager [req-e7cb0016-1e11-4577-bd15-67ab5608aa64 req-03e2c9dd-92db-47c2-80b9-66c2df07dec7 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received unexpected event network-vif-plugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c for instance with vm_state building and task_state spawning.
Apr 12 01:50:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-25ee29ba-b5fe-4a5a-885a-4926b13109db req-39f185e9-8df5-473b-9cce-8ab3918368eb service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received event network-vif-plugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-25ee29ba-b5fe-4a5a-885a-4926b13109db req-39f185e9-8df5-473b-9cce-8ab3918368eb service nova] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-25ee29ba-b5fe-4a5a-885a-4926b13109db req-39f185e9-8df5-473b-9cce-8ab3918368eb service nova] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-25ee29ba-b5fe-4a5a-885a-4926b13109db req-39f185e9-8df5-473b-9cce-8ab3918368eb service nova] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-25ee29ba-b5fe-4a5a-885a-4926b13109db req-39f185e9-8df5-473b-9cce-8ab3918368eb service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] No waiting events found dispatching network-vif-plugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:30 user nova-compute[82184]: WARNING nova.compute.manager [req-25ee29ba-b5fe-4a5a-885a-4926b13109db req-39f185e9-8df5-473b-9cce-8ab3918368eb service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received unexpected event network-vif-plugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 for instance with vm_state building and task_state spawning.
Apr 12 01:50:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-963440eb-a729-4fa0-87dc-fa68e81d30ee req-8457bab2-2e59-4c0b-b710-f59e9057bd07 service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received event network-vif-plugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-963440eb-a729-4fa0-87dc-fa68e81d30ee req-8457bab2-2e59-4c0b-b710-f59e9057bd07 service nova] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-963440eb-a729-4fa0-87dc-fa68e81d30ee req-8457bab2-2e59-4c0b-b710-f59e9057bd07 service nova] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-963440eb-a729-4fa0-87dc-fa68e81d30ee req-8457bab2-2e59-4c0b-b710-f59e9057bd07 service nova] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-963440eb-a729-4fa0-87dc-fa68e81d30ee req-8457bab2-2e59-4c0b-b710-f59e9057bd07 service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] No waiting events found dispatching network-vif-plugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:50:32 user nova-compute[82184]: WARNING nova.compute.manager [req-963440eb-a729-4fa0-87dc-fa68e81d30ee req-8457bab2-2e59-4c0b-b710-f59e9057bd07 service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received unexpected event network-vif-plugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 for instance with vm_state building and task_state spawning.
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264232.7345455, 2dbe5433-e1e5-4b85-a0f7-904c3b784335 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] VM Resumed (Lifecycle Event)
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Instance spawned successfully.
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Instance spawned successfully.
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264232.738482, 2dbe5433-e1e5-4b85-a0f7-904c3b784335 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] VM Started (Lifecycle Event)
Apr 12 01:50:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264232.7391014, 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] VM Resumed (Lifecycle Event)
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.compute.manager [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Took 10.72 seconds to spawn the instance on the hypervisor.
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.compute.manager [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Took 8.22 seconds to spawn the instance on the hypervisor.
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:50:32 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264232.7435944, 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:50:32 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] VM Started (Lifecycle Event)
Apr 12 01:50:33 user nova-compute[82184]: INFO nova.compute.manager [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Took 12.50 seconds to build instance.
Apr 12 01:50:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:50:33 user nova-compute[82184]: INFO nova.compute.manager [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Took 10.33 seconds to build instance.
Apr 12 01:50:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81b295fb-5683-4af7-8628-be50112f806f tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.692s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:50:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5aa92613-b935-434c-8520-6f52713c919c tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.540s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 01:50:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 01:50:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 01:50:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:38 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:50:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:40 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:50:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:44 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:44 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=7538MB free_disk=26.658748626708984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 371f55da-306a-4ef9-b04f-7c22e8071e5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance f2eedf78-0fd6-4cc1-8efd-50958e07fde6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cb89325c-680a-4413-8e94-4eddfaa79c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:50:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:50:45 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:50:45 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:50:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:50:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updating instance_info_cache with network_info: [{"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:50:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "221e01f2-18c8-468b-993b-480cdda60dd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:50:53 user nova-compute[82184]: INFO nova.compute.claims [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Claim successful on node user
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:50:53 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:50:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:50:54 user nova-compute[82184]: INFO nova.virt.block_device [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Booting with volume c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 at /dev/vda
Apr 12 01:50:54 user nova-compute[82184]: DEBUG nova.policy [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f288eba0f612445596edccf43f08fa22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071310920ea42f9a66e1a92d6ecd324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:50:54 user nova-compute[82184]: DEBUG os_brick.utils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:50:54 user nova-compute[82184]: INFO oslo.privsep.daemon [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpwdxu2_k9/privsep.sock']
Apr 12 01:50:54 user sudo[92495]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpwdxu2_k9/privsep.sock
Apr 12 01:50:54 user sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 01:50:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "59c7c418-902e-46b7-9302-5c630df18ca2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:50:55 user nova-compute[82184]: INFO nova.compute.claims [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Claim successful on node user
Apr 12 01:50:55 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully created port: de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:50:55 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:50:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:50:55 user nova-compute[82184]: INFO nova.virt.block_device [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Booting with volume 14875542-8ecd-404c-b962-08b834eacb86 at /dev/vda
Apr 12 01:50:55 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully created port: fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG os_brick.utils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG nova.policy [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa19aa56b6ee4a10a07eb6e421a131bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c85b2820514000b08e47046f7bd717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:50:55 user sudo[92495]: pam_unix(sudo:session): session closed for user root
Apr 12 01:50:55 user nova-compute[82184]: INFO oslo.privsep.daemon [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Spawned new privsep daemon via rootwrap
Apr 12 01:50:55 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 01:50:55 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 01:50:55 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 12 01:50:55 user nova-compute[82184]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 92498
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb494f4-8f79-4c25-8a94-b9209428b510]: (2,) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:55 user nova-compute[82184]: WARNING oslo_privsep.priv_context [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] privsep daemon already running
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5d9c4a-b121-4847-80c1-027eaf9a0677]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:55 user nova-compute[82184]: WARNING os_brick.initiator.connectors.nvmeof [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7afcf3-dfdb-4996-8d8a-ed5af57f7ea4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc67af7-5cc1-447b-84b6-b8709308e0bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[974a2800-3b95-4133-bc05-6d63c5c7882e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3e18c6-f45c-4963-ab1c-1ff948712dee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[af43c1e3-502f-4da4-8010-d497f2e730f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1825ad-0fda-47c7-8db4-419839c99127]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0098e0d6-500d-4d7a-9165-d5c54e0de8f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:50:56 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:50:56 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a22a43-097f-43ed-b040-e9ea043f95ff]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG os_brick.utils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] <== get_connector_properties: return (350ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating existing volume attachment record: 1c363c49-bb82-4337-bd8c-3b07cb2678b1 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:50:56 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:50:56 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd084fb-55be-4ce4-b4fb-65d438ef8cba]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG os_brick.utils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] <== get_connector_properties: return (1958ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating existing volume attachment record: b1c7c7a7-739b-4260-8376-153293cb3227 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully created port: 8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully created port: 6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully created port: 3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:57 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully created port: 1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:57 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully created port: b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:57 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully created port: 9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully updated port: de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-96048dec-c1cc-42a0-89bf-f4ef297bf2af req-e715006c-98a6-4216-8fdb-cb48d0ab0d32 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-changed-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-96048dec-c1cc-42a0-89bf-f4ef297bf2af req-e715006c-98a6-4216-8fdb-cb48d0ab0d32 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing instance network info cache due to event network-changed-de3cdf71-2461-4e2f-b11f-dba0cca9c85f. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-96048dec-c1cc-42a0-89bf-f4ef297bf2af req-e715006c-98a6-4216-8fdb-cb48d0ab0d32 service nova] Acquiring lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-96048dec-c1cc-42a0-89bf-f4ef297bf2af req-e715006c-98a6-4216-8fdb-cb48d0ab0d32 service nova] Acquired lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG nova.network.neutron [req-96048dec-c1cc-42a0-89bf-f4ef297bf2af req-e715006c-98a6-4216-8fdb-cb48d0ab0d32 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing network info cache for port de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG nova.network.neutron [req-96048dec-c1cc-42a0-89bf-f4ef297bf2af req-e715006c-98a6-4216-8fdb-cb48d0ab0d32 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully created port: 3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG nova.network.neutron [req-96048dec-c1cc-42a0-89bf-f4ef297bf2af req-e715006c-98a6-4216-8fdb-cb48d0ab0d32 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-96048dec-c1cc-42a0-89bf-f4ef297bf2af req-e715006c-98a6-4216-8fdb-cb48d0ab0d32 service nova] Releasing lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:50:58 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully updated port: 1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully created port: 890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully updated port: b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully updated port: 6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-8a462bc3-ab62-45c7-8d4e-f4be44320870 req-39a78ad7-23d2-42c7-a05f-0f2233ed8364 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-changed-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-8a462bc3-ab62-45c7-8d4e-f4be44320870 req-39a78ad7-23d2-42c7-a05f-0f2233ed8364 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing instance network info cache due to event network-changed-6ba40fff-9cc4-47e6-aae2-857a7b1b3445. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8a462bc3-ab62-45c7-8d4e-f4be44320870 req-39a78ad7-23d2-42c7-a05f-0f2233ed8364 service nova] Acquiring lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8a462bc3-ab62-45c7-8d4e-f4be44320870 req-39a78ad7-23d2-42c7-a05f-0f2233ed8364 service nova] Acquired lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG nova.network.neutron [req-8a462bc3-ab62-45c7-8d4e-f4be44320870 req-39a78ad7-23d2-42c7-a05f-0f2233ed8364 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing network info cache for port 6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG nova.network.neutron [req-8a462bc3-ab62-45c7-8d4e-f4be44320870 req-39a78ad7-23d2-42c7-a05f-0f2233ed8364 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG nova.network.neutron [req-8a462bc3-ab62-45c7-8d4e-f4be44320870 req-39a78ad7-23d2-42c7-a05f-0f2233ed8364 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:50:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8a462bc3-ab62-45c7-8d4e-f4be44320870 req-39a78ad7-23d2-42c7-a05f-0f2233ed8364 service nova] Releasing lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-changed-1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing instance network info cache due to event network-changed-1f3154ad-8bf5-46a4-8184-fd6f73576d78. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] Acquiring lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] Acquired lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing network info cache for port 1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully updated port: 69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully updated port: fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] Releasing lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-changed-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing instance network info cache due to event network-changed-b7d4528c-dc68-49c5-ad88-00a9ea8689f8. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] Acquiring lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] Acquired lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing network info cache for port b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-854dd1cc-52a8-4194-a629-7d07532e7de6 req-07218f17-8dbd-4a54-a379-c6924c8a43f9 service nova] Releasing lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully updated port: efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully updated port: 8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-changed-69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing instance network info cache due to event network-changed-69bce85f-9dda-4202-a608-f9c4da0cff43. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] Acquiring lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] Acquired lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing network info cache for port 69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully updated port: 1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully updated port: 3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] Releasing lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-changed-efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing instance network info cache due to event network-changed-efae59db-bdf2-467e-803b-c2b1a85c10a7. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] Acquiring lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] Acquired lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing network info cache for port efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d3636de9-58cf-4943-b719-20c89e25dc7b req-d848722a-e67f-4e91-b1e1-f94a81ecf8d9 service nova] Releasing lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-changed-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing instance network info cache due to event network-changed-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] Acquiring lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] Acquired lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing network info cache for port fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Successfully updated port: b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] Releasing lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-changed-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing instance network info cache due to event network-changed-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] Acquiring lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] Acquired lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing network info cache for port 8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully updated port: 9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.network.neutron [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] Releasing lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-changed-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing instance network info cache due to event network-changed-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] Acquiring lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] Acquired lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.network.neutron [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing network info cache for port 3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.network.neutron [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.network.neutron [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5e14ffa0-9c28-4cb9-ae40-7456fda86c12 req-989f4362-6e00-4524-8ea9-fcfdbeedbcc5 service nova] Releasing lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquired lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully updated port: 3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-changed-1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing instance network info cache due to event network-changed-1834b43d-230e-4d08-8980-3415727f8b44. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] Acquiring lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] Acquired lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.network.neutron [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing network info cache for port 1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:03 user nova-compute[82184]: DEBUG nova.network.neutron [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.network.neutron [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] Releasing lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.compute.manager [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-changed-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.compute.manager [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing instance network info cache due to event network-changed-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] Acquiring lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] Acquired lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.network.neutron [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing network info cache for port 9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Successfully updated port: 890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.network.neutron [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.network.neutron [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6e2cf5ef-f0bc-46cf-b71f-ec418947b212 req-c1ac70ed-5d3a-49db-b7e8-f7444beb509c service nova] Releasing lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquired lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.compute.manager [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-changed-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.compute.manager [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing instance network info cache due to event network-changed-b744b6a0-6c5b-4c1f-b73d-c893fe058df4. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] Acquiring lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:04 user nova-compute[82184]: INFO nova.virt.block_device [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Booting with volume 65104dd2-34df-439c-9659-ca5448f7fda7 at /dev/vdb
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.utils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:04 user nova-compute[82184]: INFO nova.virt.block_device [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Booting with volume 78172d81-0c40-40fc-bbe3-a67e1f56081d at /dev/vdb
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e3e09-9a8c-4c70-9131-802fc9bc7b22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda1c9af-9bbe-42b8-82eb-2009b1dd7af6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.utils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ecf278-49b0-4e8e-9f1a-2c562dc26bdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e7879d-a2fd-414a-971c-5be566489c4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5036c15-d886-4d7d-8f53-fc7fdd6b3ded]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:04 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58f71d9-3272-4da7-8b68-410708d8f5e0]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c84b9f-37aa-446d-82aa-1b9116dfca19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.utils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating existing volume attachment record: e3a733f4-c48f-482d-8d6e-1ca2f779e698 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1cb9d3-84c3-4432-8aca-d1155c6766e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b767514e-0e1a-4d62-840d-9deb6f8f6b92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:04 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:51:04 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[227be6d0-aab9-433a-9883-285f54c73671]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG os_brick.utils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:04 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating existing volume attachment record: 40100b8d-a29b-4558-a151-68b6a4994e95 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:51:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [{"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Releasing lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance network_info: |[{"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] Acquired lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG nova.network.neutron [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing network info cache for port b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG nova.network.neutron [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updated VIF entry in instance network info cache for port b744b6a0-6c5b-4c1f-b73d-c893fe058df4. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG nova.network.neutron [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [{"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] Releasing lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-changed-3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing instance network info cache due to event network-changed-3862628b-e679-40e9-ba14-5aaab53bb289. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] Acquiring lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG nova.network.neutron [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [{"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Releasing lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Instance network_info: |[{"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] Acquired lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:06 user nova-compute[82184]: DEBUG nova.network.neutron [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing network info cache for port 3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG nova.network.neutron [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updated VIF entry in instance network info cache for port 3862628b-e679-40e9-ba14-5aaab53bb289. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG nova.network.neutron [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [{"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] Releasing lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-changed-890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing instance network info cache due to event network-changed-890247d7-ec5c-429e-beef-5666b669f4f3. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] Acquiring lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] Acquired lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG nova.network.neutron [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing network info cache for port 890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG nova.network.neutron [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updated VIF entry in instance network info cache for port 890247d7-ec5c-429e-beef-5666b669f4f3. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG nova.network.neutron [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [{"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d2a2573-dda2-4919-8645-0cfb96419ee2 req-550b7933-8e50-4c65-b9b0-1e223c5e0479 service nova] Releasing lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:11 user nova-compute[82184]: INFO nova.virt.block_device [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Booting with volume 65567a69-c266-48ba-942d-183231131ad7 at /dev/vdc
Apr 12 01:51:11 user nova-compute[82184]: DEBUG os_brick.utils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[776bfc79-f629-4f0a-bd59-c5f150874f15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fe8935-342d-4347-91c0-893c62c9860b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa459c88-8ec3-4af1-aa51-55700094f084]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1079c892-33eb-4652-b2b2-6ded93e521cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:11 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:51:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a94b79-677d-4aa2-9b43-35bd958e5308]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG os_brick.utils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:11 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating existing volume attachment record: 58bfef5b-f2c2-46a8-8762-d36afecb1a1b {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:51:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:12 user nova-compute[82184]: INFO nova.virt.block_device [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Booting with volume 3d10e166-577b-475c-a041-3034e9e9e1cb at /dev/vdc
Apr 12 01:51:13 user nova-compute[82184]: DEBUG os_brick.utils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[906f86df-078d-43e3-a5fc-552198d2ab6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab93a6a-6e30-4006-a560-e9c7b436eeb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[85749c18-657b-423b-9a8f-4bd5fa644d84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3379eb-e614-45ab-94d3-83599282523f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:13 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:51:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7b07f7-7313-4feb-988d-888a68e3dc78]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG os_brick.utils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:13 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating existing volume attachment record: 994b49c8-e094-4440-adbb-926f9915ad25 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:51:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:51:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Creating image(s)
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Ensure instance console log exists: /opt/stack/data/nova/instances/59c7c418-902e-46b7-9302-5c630df18ca2/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Start _get_guest_xml network_info=[{"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '1c363c49-bb82-4337-bd8c-3b07cb2678b1', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uiNAbIkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59c7c418-902e-46b7-9302-5c630df18ca2', 'attached_at': '', 'detached_at': '', 'volume_id': '14875542-8ecd-404c-b962-08b834eacb86', 'serial': '14875542-8ecd-404c-b962-08b834eacb86'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'attachment_id': 'e3a733f4-c48f-482d-8d6e-1ca2f779e698', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqdwkfas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59c7c418-902e-46b7-9302-5c630df18ca2', 'attached_at': '', 'detached_at': '', 'volume_id': '65104dd2-34df-439c-9659-ca5448f7fda7', 'serial': '65104dd2-34df-439c-9659-ca5448f7fda7'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'attachment_id': '58bfef5b-f2c2-46a8-8762-d36afecb1a1b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDKTiqWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59c7c418-902e-46b7-9302-5c630df18ca2', 'attached_at': '', 'detached_at': '', 'volume_id': '65567a69-c266-48ba-942d-183231131ad7', 'serial': '65567a69-c266-48ba-942d-183231131ad7'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:51:19 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:51:19 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connector [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Factory for ISCSI on None {{(pid=82184) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uiNAbIkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:19 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:19 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:19 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ae5204-4672-4843-919e-23f27b907adf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:51:19 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[db95ae09-8b97-4ef2-898a-ee084194ec5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86] added
Apr 12 01:51:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ff8877-9ea1-4ba7-aef3-a50838ca3089]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[977137e2-7e41-4c21-b3bf-8a473dc53585]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uiNAbIkg {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uiNAbIkg" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a456042-7916-4e64-8f62-e63375e3790a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uiNAbIkg'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d00d51e-838a-4972-a770-44cf70ca9e8f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bce56c-1391-4aef-9a01-d952bb193e97]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:51:19 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:51:19 user nova-compute[82184]:  {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:19 user nova-compute[82184]: WARNING os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 01:51:19 user nova-compute[82184]: 
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ec385a-7d49-4580-a096-e871a825c42e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86, portal: 172.16.0.220,3260]
Apr 12 01:51:19 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86, portal: 172.16.0.220,3260] successful.
Apr 12 01:51:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9a6097-5f03-4bc7-82a3-9ead20473fb7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[62efbe13-cd74-4a52-997e-f0f6de9c0d86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb3a8de-1015-4b07-a185-84006f62e276]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:19 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:51:20 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Creating image(s)
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Ensure instance console log exists: /opt/stack/data/nova/instances/221e01f2-18c8-468b-993b-480cdda60dd7/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Start _get_guest_xml network_info=[{"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'b1c7c7a7-739b-4260-8376-153293cb3227', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTHVyabO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '221e01f2-18c8-468b-993b-480cdda60dd7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8', 'serial': 'c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'attachment_id': '40100b8d-a29b-4558-a151-68b6a4994e95', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUXhmTEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '221e01f2-18c8-468b-993b-480cdda60dd7', 'attached_at': '', 'detached_at': '', 'volume_id': '78172d81-0c40-40fc-bbe3-a67e1f56081d', 'serial': '78172d81-0c40-40fc-bbe3-a67e1f56081d'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'attachment_id': '994b49c8-e094-4440-adbb-926f9915ad25', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TocglzYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '221e01f2-18c8-468b-993b-480cdda60dd7', 'attached_at': '', 'detached_at': '', 'volume_id': '3d10e166-577b-475c-a041-3034e9e9e1cb', 'serial': '3d10e166-577b-475c-a041-3034e9e9e1cb'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:51:20 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:51:20 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTHVyabO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:20 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uiNAbIkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23266323662356564', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266323662356564', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.067s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:20 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:20 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqdwkfas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:20 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[22828b3a-4c0a-457d-8603-63dff5cd82c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:51:20 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bfc18b-ec1e-4bd7-bf6d-9ff84c0d58d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8] added
Apr 12 01:51:20 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ef95a8-8597-4326-8588-de3f3e52d0fc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8158a7b0-9dda-4b66-9b1f-27017db46ebc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTHVyabO {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTHVyabO" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c6d65e-4c96-47a0-9e55-90ec446597ed]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PTHVyabO'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[09af84b1-5f12-44c9-8a21-eea17049501d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[190d5cfb-0f42-488f-9128-fcb92502cc2d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:21 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:21 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d93e46-5efe-41e4-95f0-681eaad14445]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8, portal: 172.16.0.220,3260]
Apr 12 01:51:21 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8, portal: 172.16.0.220,3260] successful.
Apr 12 01:51:21 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[296b4a2f-6532-4b02-a3f7-d022ba92a987]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef0b92a-c268-4e96-a7a7-b4f2e68ef2d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:21 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:21 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:21 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:21 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80ac52d-8a5b-409c-a4d9-6db2dc90462c]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTHVyabO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23562646137613164', 'path': '/dev/sdc'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562646137613164', 'path': '/dev/sdc'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.274s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:22 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:22 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef61552c-d6e1-40a4-a13c-ff9631fde101]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:51:22 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUXhmTEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:22 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8322d893-6f78-42d9-a678-9a5ae56499cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7] added
Apr 12 01:51:22 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53863ef-e0a8-4a32-8545-0119a599aa53]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6384f9-db56-4eb0-b36e-adf230dd05b8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rqdwkfas {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rqdwkfas" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8525ff2d-101a-4dd7-a992-80fe9c1e6fea]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rqdwkfas'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b3d9dd-2dd8-4ec7-9daa-d928157c9cf8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[871cf42c-5990-428a-a9e2-3fa135f8f2e7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:22 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:22 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:22 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:22 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[10535552-2afa-486d-9835-fc39dbe1204f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7, portal: 172.16.0.220,3260]
Apr 12 01:51:22 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7, portal: 172.16.0.220,3260] successful.
Apr 12 01:51:22 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fffeffd-9187-4927-a55c-bca111e106a0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9faf4ff-6a78-4a32-b177-bb259f3376e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:22 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:22 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:22 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:22 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:22 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:22 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a79d04-cd1d-42e5-b340-6ad5952fd43a]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqdwkfas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] <== connect_volume: return (2556ms) {'type': 'block', 'scsi_wwn': '23137653434376537', 'path': '/dev/sdd'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137653434376537', 'path': '/dev/sdd'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.248s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:23 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:23 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee35339-449d-45e2-8b3a-c260438f9f1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:51:23 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDKTiqWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:23 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b95d5a-45f7-4f2f-9341-4c39d5173d7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d] added
Apr 12 01:51:23 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[501523ee-db35-44fb-9a88-681880353a3b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ae3323-b02c-492e-bbf9-3ad8400dcbda]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUXhmTEO {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUXhmTEO" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c037c834-4a9b-463e-926e-54658f97b9f0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iUXhmTEO'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce206f5-cca0-4aa5-b373-0f5dbb8b7f0d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ef7cdc-a1d1-4787-a18b-b9c17f22ff92]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fa48ef-1962-4705-ac8c-75ad76a23fb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d, portal: 172.16.0.220,3260]
Apr 12 01:51:23 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d, portal: 172.16.0.220,3260] successful.
Apr 12 01:51:23 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64773de-fc5a-44aa-8ff4-2eb6710bf4b0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c6dc2d-92a1-4c21-8e7a-1426eb3b59ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:23 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:23 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:23 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e680455-4f81-4aab-bc7c-3dba8670df53]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:23 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUXhmTEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] <== connect_volume: return (2651ms) {'type': 'block', 'scsi_wwn': '23337326635303938', 'path': '/dev/sde'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337326635303938', 'path': '/dev/sde'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.360s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:24 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:24 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[407b9e63-1b75-4303-a0ab-a7a89e1ea3ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:51:24 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TocglzYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:24 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc597287-e71f-49b8-a197-371082770209]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7] added
Apr 12 01:51:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9eecc0-89e8-47b9-960e-ed6d286b42a5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67c7672-3d96-4a61-8d9b-d8de50ac9a44]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDKTiqWy {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gDKTiqWy" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a4ac6f-943a-410c-b779-6d651dc8c2cd]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gDKTiqWy'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c7553a-8bad-4289-8a31-9e1a1aeb2ec8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f0ebd4-6807-443f-b536-4024769f2dcd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:24 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:24 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:24 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:24 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:24 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:24 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --login" returned: 0 in 0.145s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d2ff11-c4a3-4816-a398-33f05ac5c3ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7, portal: 172.16.0.220,3260]
Apr 12 01:51:25 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7, portal: 172.16.0.220,3260] successful.
Apr 12 01:51:25 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd845e3-01da-469f-8c02-385ae588a9a7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca7b77-95ab-4d01-8e6c-3a330a011606]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:25 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:25 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:25 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:25 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:25 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:25 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:25 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:25 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:25 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:25 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4cea27-ebc1-42eb-8212-c40afc13655f]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDKTiqWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] <== connect_volume: return (2754ms) {'type': 'block', 'scsi_wwn': '23062623662646431', 'path': '/dev/sdf'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062623662646431', 'path': '/dev/sdf'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.369s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:26 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:26 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0f:f3,bridge_name='br-int',has_traffic_filtering=True,id=6ba40fff-9cc4-47e6-aae2-857a7b1b3445,network=Network(635d5017-87b6-4086-acb7-464c3f0841ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba40fff-9c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:73,bridge_name='br-int',has_traffic_filtering=True,id=69bce85f-9dda-4202-a608-f9c4da0cff43,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69bce85f-9d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c2:8b,bridge_name='br-int',has_traffic_filtering=True,id=efae59db-bdf2-467e-803b-c2b1a85c10a7,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefae59db-bd') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:2d:bc,bridge_name='br-int',has_traffic_filtering=True,id=1834b43d-230e-4d08-8980-3415727f8b44,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1834b43d-23') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef8b50f-da') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:b6:c6,bridge_name='br-int',has_traffic_filtering=True,id=3862628b-e679-40e9-ba14-5aaab53bb289,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3862628b-e6') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:61:db,bridge_name='br-int',has_traffic_filtering=True,id=890247d7-ec5c-429e-beef-5666b669f4f3,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890247d7-ec') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.objects.instance [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lazy-loading 'pci_devices' on Instance uuid 59c7c418-902e-46b7-9302-5c630df18ca2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d82307-68e5-48a3-8255-7f227cbdc03f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:51:26 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:51:26 user nova-compute[82184]:   <uuid>59c7c418-902e-46b7-9302-5c630df18ca2</uuid>
Apr 12 01:51:26 user nova-compute[82184]:   <name>instance-0000000b</name>
Apr 12 01:51:26 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:51:26 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:51:26 user nova-compute[82184]:   <metadata>
Apr 12 01:51:26 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:51:26 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:51:26 user nova-compute[82184]:       <nova:name>tempest-device-tagging-server-1664937775</nova:name>
Apr 12 01:51:26 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:51:19</nova:creationTime>
Apr 12 01:51:26 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:51:26 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:51:26 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:51:26 user nova-compute[82184]:       <nova:owner>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:user uuid="aa19aa56b6ee4a10a07eb6e421a131bd">tempest-TaggedBootDevicesTest_v242-1956984568-project-member</nova:user>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:project uuid="85c85b2820514000b08e47046f7bd717">tempest-TaggedBootDevicesTest_v242-1956984568</nova:project>
Apr 12 01:51:26 user nova-compute[82184]:       </nova:owner>
Apr 12 01:51:26 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:51:26 user nova-compute[82184]:       <nova:ports>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:port uuid="6ba40fff-9cc4-47e6-aae2-857a7b1b3445">
Apr 12 01:51:26 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 01:51:26 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:port uuid="69bce85f-9dda-4202-a608-f9c4da0cff43">
Apr 12 01:51:26 user nova-compute[82184]:           <nova:ip type="fixed" address="10.1.1.72" ipVersion="4"/>
Apr 12 01:51:26 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:port uuid="efae59db-bdf2-467e-803b-c2b1a85c10a7">
Apr 12 01:51:26 user nova-compute[82184]:           <nova:ip type="fixed" address="10.1.1.226" ipVersion="4"/>
Apr 12 01:51:26 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:port uuid="1834b43d-230e-4d08-8980-3415727f8b44">
Apr 12 01:51:26 user nova-compute[82184]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Apr 12 01:51:26 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:port uuid="9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9">
Apr 12 01:51:26 user nova-compute[82184]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Apr 12 01:51:26 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:port uuid="3862628b-e679-40e9-ba14-5aaab53bb289">
Apr 12 01:51:26 user nova-compute[82184]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 01:51:26 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:26 user nova-compute[82184]:         <nova:port uuid="890247d7-ec5c-429e-beef-5666b669f4f3">
Apr 12 01:51:26 user nova-compute[82184]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 01:51:26 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:26 user nova-compute[82184]:       </nova:ports>
Apr 12 01:51:26 user nova-compute[82184]:     </nova:instance>
Apr 12 01:51:26 user nova-compute[82184]:   </metadata>
Apr 12 01:51:26 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:51:26 user nova-compute[82184]:     <system>
Apr 12 01:51:26 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:51:26 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:51:26 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:51:26 user nova-compute[82184]:       <entry name="serial">59c7c418-902e-46b7-9302-5c630df18ca2</entry>
Apr 12 01:51:26 user nova-compute[82184]:       <entry name="uuid">59c7c418-902e-46b7-9302-5c630df18ca2</entry>
Apr 12 01:51:26 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:51:26 user nova-compute[82184]:     </system>
Apr 12 01:51:26 user nova-compute[82184]:   </sysinfo>
Apr 12 01:51:26 user nova-compute[82184]:   <os>
Apr 12 01:51:26 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:51:26 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:51:26 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:51:26 user nova-compute[82184]:   </os>
Apr 12 01:51:26 user nova-compute[82184]:   <features>
Apr 12 01:51:26 user nova-compute[82184]:     <acpi/>
Apr 12 01:51:26 user nova-compute[82184]:     <apic/>
Apr 12 01:51:26 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:51:26 user nova-compute[82184]:   </features>
Apr 12 01:51:26 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:51:26 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:51:26 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:51:26 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:51:26 user nova-compute[82184]:   </clock>
Apr 12 01:51:26 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:51:26 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:51:26 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:51:26 user nova-compute[82184]:   </cpu>
Apr 12 01:51:26 user nova-compute[82184]:   <devices>
Apr 12 01:51:26 user nova-compute[82184]:     <disk type="file" device="cdrom">
Apr 12 01:51:26 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 01:51:26 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/59c7c418-902e-46b7-9302-5c630df18ca2/disk.config"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="hda" bus="ide"/>
Apr 12 01:51:26 user nova-compute[82184]:     </disk>
Apr 12 01:51:26 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:51:26 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:51:26 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:       <serial>14875542-8ecd-404c-b962-08b834eacb86</serial>
Apr 12 01:51:26 user nova-compute[82184]:     </disk>
Apr 12 01:51:26 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:51:26 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:51:26 user nova-compute[82184]:       <source dev="/dev/sdd"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:       <serial>65104dd2-34df-439c-9659-ca5448f7fda7</serial>
Apr 12 01:51:26 user nova-compute[82184]:     </disk>
Apr 12 01:51:26 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:51:26 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:51:26 user nova-compute[82184]:       <source dev="/dev/sdf"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="vdc" bus="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:       <serial>65567a69-c266-48ba-942d-183231131ad7</serial>
Apr 12 01:51:26 user nova-compute[82184]:     </disk>
Apr 12 01:51:26 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:26 user nova-compute[82184]:       <mac address="fa:16:3e:a7:0f:f3"/>
Apr 12 01:51:26 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="tap6ba40fff-9c"/>
Apr 12 01:51:26 user nova-compute[82184]:     </interface>
Apr 12 01:51:26 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:26 user nova-compute[82184]:       <mac address="fa:16:3e:94:19:73"/>
Apr 12 01:51:26 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="tap69bce85f-9d"/>
Apr 12 01:51:26 user nova-compute[82184]:     </interface>
Apr 12 01:51:26 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:26 user nova-compute[82184]:       <mac address="fa:16:3e:07:c2:8b"/>
Apr 12 01:51:26 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="tapefae59db-bd"/>
Apr 12 01:51:26 user nova-compute[82184]:     </interface>
Apr 12 01:51:26 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:26 user nova-compute[82184]:       <mac address="fa:16:3e:2a:2d:bc"/>
Apr 12 01:51:26 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="tap1834b43d-23"/>
Apr 12 01:51:26 user nova-compute[82184]:     </interface>
Apr 12 01:51:26 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:26 user nova-compute[82184]:       <mac address="fa:16:3e:6b:2c:bb"/>
Apr 12 01:51:26 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="tap9ef8b50f-da"/>
Apr 12 01:51:26 user nova-compute[82184]:     </interface>
Apr 12 01:51:26 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:26 user nova-compute[82184]:       <mac address="fa:16:3e:1b:b6:c6"/>
Apr 12 01:51:26 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="tap3862628b-e6"/>
Apr 12 01:51:26 user nova-compute[82184]:     </interface>
Apr 12 01:51:26 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:26 user nova-compute[82184]:       <mac address="fa:16:3e:93:61:db"/>
Apr 12 01:51:26 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:26 user nova-compute[82184]:       <target dev="tap890247d7-ec"/>
Apr 12 01:51:26 user nova-compute[82184]:     </interface>
Apr 12 01:51:26 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:51:26 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/59c7c418-902e-46b7-9302-5c630df18ca2/console.log" append="off"/>
Apr 12 01:51:26 user nova-compute[82184]:     </serial>
Apr 12 01:51:26 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:51:26 user nova-compute[82184]:     <video>
Apr 12 01:51:26 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:26 user nova-compute[82184]:     </video>
Apr 12 01:51:26 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:51:26 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:51:26 user nova-compute[82184]:     </rng>
Apr 12 01:51:26 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:51:26 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:51:26 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:51:26 user nova-compute[82184]:     </memballoon>
Apr 12 01:51:26 user nova-compute[82184]:   </devices>
Apr 12 01:51:26 user nova-compute[82184]: </domain>
Apr 12 01:51:26 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0f:f3,bridge_name='br-int',has_traffic_filtering=True,id=6ba40fff-9cc4-47e6-aae2-857a7b1b3445,network=Network(635d5017-87b6-4086-acb7-464c3f0841ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba40fff-9c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0f:f3,bridge_name='br-int',has_traffic_filtering=True,id=6ba40fff-9cc4-47e6-aae2-857a7b1b3445,network=Network(635d5017-87b6-4086-acb7-464c3f0841ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba40fff-9c') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ba40fff-9c, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ba40fff-9c, col_values=(('external_ids', {'iface-id': '6ba40fff-9cc4-47e6-aae2-857a7b1b3445', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:0f:f3', 'vm-uuid': '59c7c418-902e-46b7-9302-5c630df18ca2'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26835679-2bcf-422b-965b-259aeebad1b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb] added
Apr 12 01:51:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: INFO os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:0f:f3,bridge_name='br-int',has_traffic_filtering=True,id=6ba40fff-9cc4-47e6-aae2-857a7b1b3445,network=Network(635d5017-87b6-4086-acb7-464c3f0841ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba40fff-9c')
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:73,bridge_name='br-int',has_traffic_filtering=True,id=69bce85f-9dda-4202-a608-f9c4da0cff43,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69bce85f-9d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:73,bridge_name='br-int',has_traffic_filtering=True,id=69bce85f-9dda-4202-a608-f9c4da0cff43,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69bce85f-9d') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69bce85f-9d, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69bce85f-9d, col_values=(('external_ids', {'iface-id': '69bce85f-9dda-4202-a608-f9c4da0cff43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:19:73', 'vm-uuid': '59c7c418-902e-46b7-9302-5c630df18ca2'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0f8437-f754-4fcf-a6d6-246bfc30e6ae]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: INFO os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:73,bridge_name='br-int',has_traffic_filtering=True,id=69bce85f-9dda-4202-a608-f9c4da0cff43,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69bce85f-9d')
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c2:8b,bridge_name='br-int',has_traffic_filtering=True,id=efae59db-bdf2-467e-803b-c2b1a85c10a7,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefae59db-bd') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c2:8b,bridge_name='br-int',has_traffic_filtering=True,id=efae59db-bdf2-467e-803b-c2b1a85c10a7,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefae59db-bd') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c3f991-6892-4875-9866-ca9a05c7c6a0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TocglzYD {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefae59db-bd, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefae59db-bd, col_values=(('external_ids', {'iface-id': 'efae59db-bdf2-467e-803b-c2b1a85c10a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:c2:8b', 'vm-uuid': '59c7c418-902e-46b7-9302-5c630df18ca2'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TocglzYD" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a212367-1d0d-499b-917f-0becb8bdb1fb]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TocglzYD'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: INFO os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c2:8b,bridge_name='br-int',has_traffic_filtering=True,id=efae59db-bdf2-467e-803b-c2b1a85c10a7,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefae59db-bd')
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:2d:bc,bridge_name='br-int',has_traffic_filtering=True,id=1834b43d-230e-4d08-8980-3415727f8b44,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1834b43d-23') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:2d:bc,bridge_name='br-int',has_traffic_filtering=True,id=1834b43d-230e-4d08-8980-3415727f8b44,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1834b43d-23') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1834b43d-23, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1834b43d-23, col_values=(('external_ids', {'iface-id': '1834b43d-230e-4d08-8980-3415727f8b44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:2d:bc', 'vm-uuid': '59c7c418-902e-46b7-9302-5c630df18ca2'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b9efa7-14bf-40c3-8f1c-35e47249af2f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdbd450-417d-4d12-a8bb-bd56a118ad76]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: INFO os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:2d:bc,bridge_name='br-int',has_traffic_filtering=True,id=1834b43d-230e-4d08-8980-3415727f8b44,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1834b43d-23')
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef8b50f-da') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef8b50f-da') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ef8b50f-da, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9ef8b50f-da, col_values=(('external_ids', {'iface-id': '9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:2c:bb', 'vm-uuid': '59c7c418-902e-46b7-9302-5c630df18ca2'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: INFO os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef8b50f-da')
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:b6:c6,bridge_name='br-int',has_traffic_filtering=True,id=3862628b-e679-40e9-ba14-5aaab53bb289,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3862628b-e6') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:b6:c6,bridge_name='br-int',has_traffic_filtering=True,id=3862628b-e679-40e9-ba14-5aaab53bb289,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3862628b-e6') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3862628b-e6, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3862628b-e6, col_values=(('external_ids', {'iface-id': '3862628b-e679-40e9-ba14-5aaab53bb289', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:b6:c6', 'vm-uuid': '59c7c418-902e-46b7-9302-5c630df18ca2'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c6c060-b05f-43de-a9e8-f9798d2ca112]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb, portal: 172.16.0.220,3260]
Apr 12 01:51:26 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb, portal: 172.16.0.220,3260] successful.
Apr 12 01:51:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9163ba6-1a02-4e8c-b91b-f9976e15b8c8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: INFO os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:b6:c6,bridge_name='br-int',has_traffic_filtering=True,id=3862628b-e679-40e9-ba14-5aaab53bb289,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3862628b-e6')
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:61:db,bridge_name='br-int',has_traffic_filtering=True,id=890247d7-ec5c-429e-beef-5666b669f4f3,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890247d7-ec') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:61:db,bridge_name='br-int',has_traffic_filtering=True,id=890247d7-ec5c-429e-beef-5666b669f4f3,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890247d7-ec') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767d6e3-b927-458c-9e9e-ce7deada7151]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:26 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap890247d7-ec, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap890247d7-ec, col_values=(('external_ids', {'iface-id': '890247d7-ec5c-429e-beef-5666b669f4f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:61:db', 'vm-uuid': '59c7c418-902e-46b7-9302-5c630df18ca2'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9891075-06aa-4c86-b54f-097233e4c87d]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TocglzYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:26 user nova-compute[82184]: INFO os_vif [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:61:db,bridge_name='br-int',has_traffic_filtering=True,id=890247d7-ec5c-429e-beef-5666b669f4f3,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890247d7-ec')
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] No BDM found with device name hda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] No VIF found with MAC fa:16:3e:a7:0f:f3, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] No VIF found with MAC fa:16:3e:6b:2c:bb, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:51:26 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Using config drive
Apr 12 01:51:26 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Creating config drive at /opt/stack/data/nova/instances/59c7c418-902e-46b7-9302-5c630df18ca2/disk.config
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/59c7c418-902e-46b7-9302-5c630df18ca2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc2ej4w09 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/59c7c418-902e-46b7-9302-5c630df18ca2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpc2ej4w09" returned: 0 in 0.054s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] <== connect_volume: return (2739ms) {'type': 'block', 'scsi_wwn': '23937396336366364', 'path': '/dev/sdg'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937396336366364', 'path': '/dev/sdg'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:67:29,bridge_name='br-int',has_traffic_filtering=True,id=de3cdf71-2461-4e2f-b11f-dba0cca9c85f,network=Network(c67ab087-9504-4225-ae6f-3584d8223c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3cdf71-24') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:6c:73,bridge_name='br-int',has_traffic_filtering=True,id=1f3154ad-8bf5-46a4-8184-fd6f73576d78,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f3154ad-8b') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:11:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7d4528c-dc68-49c5-ad88-00a9ea8689f8,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d4528c-dc') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:f0,bridge_name='br-int',has_traffic_filtering=True,id=fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb465ea4-ce') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:4e,bridge_name='br-int',has_traffic_filtering=True,id=8abd0ba3-643e-45d8-ab51-c693c4b2f1f1,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abd0ba3-64') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cf:3e,bridge_name='br-int',has_traffic_filtering=True,id=3b39d5eb-3055-44f9-8be3-4cabeddd3e3f,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b39d5eb-30') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bc:10,bridge_name='br-int',has_traffic_filtering=True,id=b744b6a0-6c5b-4c1f-b73d-c893fe058df4,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb744b6a0-6c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.objects.instance [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lazy-loading 'pci_devices' on Instance uuid 221e01f2-18c8-468b-993b-480cdda60dd7 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:51:27 user nova-compute[82184]:   <uuid>221e01f2-18c8-468b-993b-480cdda60dd7</uuid>
Apr 12 01:51:27 user nova-compute[82184]:   <name>instance-0000000a</name>
Apr 12 01:51:27 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:51:27 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:51:27 user nova-compute[82184]:   <metadata>
Apr 12 01:51:27 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:51:27 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:51:27 user nova-compute[82184]:       <nova:name>tempest-device-tagging-server-1698777031</nova:name>
Apr 12 01:51:27 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:51:20</nova:creationTime>
Apr 12 01:51:27 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:51:27 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:51:27 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:51:27 user nova-compute[82184]:       <nova:owner>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:user uuid="f288eba0f612445596edccf43f08fa22">tempest-TaggedBootDevicesTest-1403588062-project-member</nova:user>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:project uuid="3071310920ea42f9a66e1a92d6ecd324">tempest-TaggedBootDevicesTest-1403588062</nova:project>
Apr 12 01:51:27 user nova-compute[82184]:       </nova:owner>
Apr 12 01:51:27 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:51:27 user nova-compute[82184]:       <nova:ports>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:port uuid="de3cdf71-2461-4e2f-b11f-dba0cca9c85f">
Apr 12 01:51:27 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 01:51:27 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:port uuid="1f3154ad-8bf5-46a4-8184-fd6f73576d78">
Apr 12 01:51:27 user nova-compute[82184]:           <nova:ip type="fixed" address="10.1.1.160" ipVersion="4"/>
Apr 12 01:51:27 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:port uuid="b7d4528c-dc68-49c5-ad88-00a9ea8689f8">
Apr 12 01:51:27 user nova-compute[82184]:           <nova:ip type="fixed" address="10.1.1.119" ipVersion="4"/>
Apr 12 01:51:27 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:port uuid="fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43">
Apr 12 01:51:27 user nova-compute[82184]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
Apr 12 01:51:27 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:port uuid="8abd0ba3-643e-45d8-ab51-c693c4b2f1f1">
Apr 12 01:51:27 user nova-compute[82184]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Apr 12 01:51:27 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:port uuid="3b39d5eb-3055-44f9-8be3-4cabeddd3e3f">
Apr 12 01:51:27 user nova-compute[82184]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 01:51:27 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:27 user nova-compute[82184]:         <nova:port uuid="b744b6a0-6c5b-4c1f-b73d-c893fe058df4">
Apr 12 01:51:27 user nova-compute[82184]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 01:51:27 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:27 user nova-compute[82184]:       </nova:ports>
Apr 12 01:51:27 user nova-compute[82184]:     </nova:instance>
Apr 12 01:51:27 user nova-compute[82184]:   </metadata>
Apr 12 01:51:27 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:51:27 user nova-compute[82184]:     <system>
Apr 12 01:51:27 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:51:27 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:51:27 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:51:27 user nova-compute[82184]:       <entry name="serial">221e01f2-18c8-468b-993b-480cdda60dd7</entry>
Apr 12 01:51:27 user nova-compute[82184]:       <entry name="uuid">221e01f2-18c8-468b-993b-480cdda60dd7</entry>
Apr 12 01:51:27 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:51:27 user nova-compute[82184]:     </system>
Apr 12 01:51:27 user nova-compute[82184]:   </sysinfo>
Apr 12 01:51:27 user nova-compute[82184]:   <os>
Apr 12 01:51:27 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:51:27 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:51:27 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:51:27 user nova-compute[82184]:   </os>
Apr 12 01:51:27 user nova-compute[82184]:   <features>
Apr 12 01:51:27 user nova-compute[82184]:     <acpi/>
Apr 12 01:51:27 user nova-compute[82184]:     <apic/>
Apr 12 01:51:27 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:51:27 user nova-compute[82184]:   </features>
Apr 12 01:51:27 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:51:27 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:51:27 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:51:27 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:51:27 user nova-compute[82184]:   </clock>
Apr 12 01:51:27 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:51:27 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:51:27 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:51:27 user nova-compute[82184]:   </cpu>
Apr 12 01:51:27 user nova-compute[82184]:   <devices>
Apr 12 01:51:27 user nova-compute[82184]:     <disk type="file" device="cdrom">
Apr 12 01:51:27 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 01:51:27 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/221e01f2-18c8-468b-993b-480cdda60dd7/disk.config"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="hda" bus="ide"/>
Apr 12 01:51:27 user nova-compute[82184]:     </disk>
Apr 12 01:51:27 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:51:27 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:51:27 user nova-compute[82184]:       <source dev="/dev/sdc"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:       <serial>c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8</serial>
Apr 12 01:51:27 user nova-compute[82184]:     </disk>
Apr 12 01:51:27 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:51:27 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:51:27 user nova-compute[82184]:       <source dev="/dev/sde"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:       <serial>78172d81-0c40-40fc-bbe3-a67e1f56081d</serial>
Apr 12 01:51:27 user nova-compute[82184]:     </disk>
Apr 12 01:51:27 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:51:27 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:51:27 user nova-compute[82184]:       <source dev="/dev/sdg"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="vdc" bus="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:       <serial>3d10e166-577b-475c-a041-3034e9e9e1cb</serial>
Apr 12 01:51:27 user nova-compute[82184]:     </disk>
Apr 12 01:51:27 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:27 user nova-compute[82184]:       <mac address="fa:16:3e:ed:67:29"/>
Apr 12 01:51:27 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="tapde3cdf71-24"/>
Apr 12 01:51:27 user nova-compute[82184]:     </interface>
Apr 12 01:51:27 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:27 user nova-compute[82184]:       <mac address="fa:16:3e:42:6c:73"/>
Apr 12 01:51:27 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="tap1f3154ad-8b"/>
Apr 12 01:51:27 user nova-compute[82184]:     </interface>
Apr 12 01:51:27 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:27 user nova-compute[82184]:       <mac address="fa:16:3e:93:11:ac"/>
Apr 12 01:51:27 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="tapb7d4528c-dc"/>
Apr 12 01:51:27 user nova-compute[82184]:     </interface>
Apr 12 01:51:27 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:27 user nova-compute[82184]:       <mac address="fa:16:3e:1b:86:f0"/>
Apr 12 01:51:27 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="tapfb465ea4-ce"/>
Apr 12 01:51:27 user nova-compute[82184]:     </interface>
Apr 12 01:51:27 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:27 user nova-compute[82184]:       <mac address="fa:16:3e:b2:23:4e"/>
Apr 12 01:51:27 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="tap8abd0ba3-64"/>
Apr 12 01:51:27 user nova-compute[82184]:     </interface>
Apr 12 01:51:27 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:27 user nova-compute[82184]:       <mac address="fa:16:3e:e5:cf:3e"/>
Apr 12 01:51:27 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="tap3b39d5eb-30"/>
Apr 12 01:51:27 user nova-compute[82184]:     </interface>
Apr 12 01:51:27 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:27 user nova-compute[82184]:       <mac address="fa:16:3e:6e:bc:10"/>
Apr 12 01:51:27 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:27 user nova-compute[82184]:       <target dev="tapb744b6a0-6c"/>
Apr 12 01:51:27 user nova-compute[82184]:     </interface>
Apr 12 01:51:27 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:51:27 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/221e01f2-18c8-468b-993b-480cdda60dd7/console.log" append="off"/>
Apr 12 01:51:27 user nova-compute[82184]:     </serial>
Apr 12 01:51:27 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:51:27 user nova-compute[82184]:     <video>
Apr 12 01:51:27 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:27 user nova-compute[82184]:     </video>
Apr 12 01:51:27 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:51:27 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:51:27 user nova-compute[82184]:     </rng>
Apr 12 01:51:27 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:51:27 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:51:27 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:51:27 user nova-compute[82184]:     </memballoon>
Apr 12 01:51:27 user nova-compute[82184]:   </devices>
Apr 12 01:51:27 user nova-compute[82184]: </domain>
Apr 12 01:51:27 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:67:29,bridge_name='br-int',has_traffic_filtering=True,id=de3cdf71-2461-4e2f-b11f-dba0cca9c85f,network=Network(c67ab087-9504-4225-ae6f-3584d8223c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3cdf71-24') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:67:29,bridge_name='br-int',has_traffic_filtering=True,id=de3cdf71-2461-4e2f-b11f-dba0cca9c85f,network=Network(c67ab087-9504-4225-ae6f-3584d8223c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3cdf71-24') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde3cdf71-24, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde3cdf71-24, col_values=(('external_ids', {'iface-id': 'de3cdf71-2461-4e2f-b11f-dba0cca9c85f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:67:29', 'vm-uuid': '221e01f2-18c8-468b-993b-480cdda60dd7'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: INFO os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:67:29,bridge_name='br-int',has_traffic_filtering=True,id=de3cdf71-2461-4e2f-b11f-dba0cca9c85f,network=Network(c67ab087-9504-4225-ae6f-3584d8223c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3cdf71-24')
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:6c:73,bridge_name='br-int',has_traffic_filtering=True,id=1f3154ad-8bf5-46a4-8184-fd6f73576d78,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f3154ad-8b') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:6c:73,bridge_name='br-int',has_traffic_filtering=True,id=1f3154ad-8bf5-46a4-8184-fd6f73576d78,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f3154ad-8b') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f3154ad-8b, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f3154ad-8b, col_values=(('external_ids', {'iface-id': '1f3154ad-8bf5-46a4-8184-fd6f73576d78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:6c:73', 'vm-uuid': '221e01f2-18c8-468b-993b-480cdda60dd7'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: INFO os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:6c:73,bridge_name='br-int',has_traffic_filtering=True,id=1f3154ad-8bf5-46a4-8184-fd6f73576d78,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f3154ad-8b')
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:11:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7d4528c-dc68-49c5-ad88-00a9ea8689f8,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d4528c-dc') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:11:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7d4528c-dc68-49c5-ad88-00a9ea8689f8,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d4528c-dc') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7d4528c-dc, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7d4528c-dc, col_values=(('external_ids', {'iface-id': 'b7d4528c-dc68-49c5-ad88-00a9ea8689f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:11:ac', 'vm-uuid': '221e01f2-18c8-468b-993b-480cdda60dd7'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: INFO os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:11:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7d4528c-dc68-49c5-ad88-00a9ea8689f8,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d4528c-dc')
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:f0,bridge_name='br-int',has_traffic_filtering=True,id=fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb465ea4-ce') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:f0,bridge_name='br-int',has_traffic_filtering=True,id=fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb465ea4-ce') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb465ea4-ce, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb465ea4-ce, col_values=(('external_ids', {'iface-id': 'fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:86:f0', 'vm-uuid': '221e01f2-18c8-468b-993b-480cdda60dd7'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: INFO os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:f0,bridge_name='br-int',has_traffic_filtering=True,id=fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb465ea4-ce')
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:4e,bridge_name='br-int',has_traffic_filtering=True,id=8abd0ba3-643e-45d8-ab51-c693c4b2f1f1,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abd0ba3-64') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:4e,bridge_name='br-int',has_traffic_filtering=True,id=8abd0ba3-643e-45d8-ab51-c693c4b2f1f1,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abd0ba3-64') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8abd0ba3-64, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8abd0ba3-64, col_values=(('external_ids', {'iface-id': '8abd0ba3-643e-45d8-ab51-c693c4b2f1f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:23:4e', 'vm-uuid': '221e01f2-18c8-468b-993b-480cdda60dd7'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: INFO os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:4e,bridge_name='br-int',has_traffic_filtering=True,id=8abd0ba3-643e-45d8-ab51-c693c4b2f1f1,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abd0ba3-64')
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cf:3e,bridge_name='br-int',has_traffic_filtering=True,id=3b39d5eb-3055-44f9-8be3-4cabeddd3e3f,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b39d5eb-30') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cf:3e,bridge_name='br-int',has_traffic_filtering=True,id=3b39d5eb-3055-44f9-8be3-4cabeddd3e3f,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b39d5eb-30') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b39d5eb-30, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b39d5eb-30, col_values=(('external_ids', {'iface-id': '3b39d5eb-3055-44f9-8be3-4cabeddd3e3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:cf:3e', 'vm-uuid': '221e01f2-18c8-468b-993b-480cdda60dd7'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: INFO os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cf:3e,bridge_name='br-int',has_traffic_filtering=True,id=3b39d5eb-3055-44f9-8be3-4cabeddd3e3f,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b39d5eb-30')
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bc:10,bridge_name='br-int',has_traffic_filtering=True,id=b744b6a0-6c5b-4c1f-b73d-c893fe058df4,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb744b6a0-6c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bc:10,bridge_name='br-int',has_traffic_filtering=True,id=b744b6a0-6c5b-4c1f-b73d-c893fe058df4,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb744b6a0-6c') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb744b6a0-6c, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb744b6a0-6c, col_values=(('external_ids', {'iface-id': 'b744b6a0-6c5b-4c1f-b73d-c893fe058df4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:bc:10', 'vm-uuid': '221e01f2-18c8-468b-993b-480cdda60dd7'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.compute.manager [req-f29f002c-e8e3-4f5d-ab9c-e0c491e19d58 req-39da3c59-3c94-4676-8d37-87f7f7012b87 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f29f002c-e8e3-4f5d-ab9c-e0c491e19d58 req-39da3c59-3c94-4676-8d37-87f7f7012b87 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f29f002c-e8e3-4f5d-ab9c-e0c491e19d58 req-39da3c59-3c94-4676-8d37-87f7f7012b87 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f29f002c-e8e3-4f5d-ab9c-e0c491e19d58 req-39da3c59-3c94-4676-8d37-87f7f7012b87 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.compute.manager [req-f29f002c-e8e3-4f5d-ab9c-e0c491e19d58 req-39da3c59-3c94-4676-8d37-87f7f7012b87 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:28 user nova-compute[82184]: WARNING nova.compute.manager [req-f29f002c-e8e3-4f5d-ab9c-e0c491e19d58 req-39da3c59-3c94-4676-8d37-87f7f7012b87 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 for instance with vm_state building and task_state spawning.
Apr 12 01:51:28 user nova-compute[82184]: INFO os_vif [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bc:10,bridge_name='br-int',has_traffic_filtering=True,id=b744b6a0-6c5b-4c1f-b73d-c893fe058df4,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb744b6a0-6c')
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] No BDM found with device name hda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] No VIF found with MAC fa:16:3e:ed:67:29, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] No VIF found with MAC fa:16:3e:b2:23:4e, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:51:28 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Using config drive
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Creating config drive at /opt/stack/data/nova/instances/221e01f2-18c8-468b-993b-480cdda60dd7/disk.config
Apr 12 01:51:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/221e01f2-18c8-468b-993b-480cdda60dd7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_vyewrvb {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/221e01f2-18c8-468b-993b-480cdda60dd7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_vyewrvb" returned: 0 in 0.054s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-9a660ffb-2943-4a4c-8ade-f54aba5ec167 req-179b14e6-9f1b-4475-8282-825a11713c45 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9a660ffb-2943-4a4c-8ade-f54aba5ec167 req-179b14e6-9f1b-4475-8282-825a11713c45 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9a660ffb-2943-4a4c-8ade-f54aba5ec167 req-179b14e6-9f1b-4475-8282-825a11713c45 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9a660ffb-2943-4a4c-8ade-f54aba5ec167 req-179b14e6-9f1b-4475-8282-825a11713c45 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-9a660ffb-2943-4a4c-8ade-f54aba5ec167 req-179b14e6-9f1b-4475-8282-825a11713c45 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:29 user nova-compute[82184]: WARNING nova.compute.manager [req-9a660ffb-2943-4a4c-8ade-f54aba5ec167 req-179b14e6-9f1b-4475-8282-825a11713c45 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-69bce85f-9dda-4202-a608-f9c4da0cff43 for instance with vm_state building and task_state spawning.
Apr 12 01:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-6f5b65aa-0874-4305-ac4e-292af80371d5 req-9bd85008-12c8-4843-a0ae-31b4bde66d60 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6f5b65aa-0874-4305-ac4e-292af80371d5 req-9bd85008-12c8-4843-a0ae-31b4bde66d60 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6f5b65aa-0874-4305-ac4e-292af80371d5 req-9bd85008-12c8-4843-a0ae-31b4bde66d60 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6f5b65aa-0874-4305-ac4e-292af80371d5 req-9bd85008-12c8-4843-a0ae-31b4bde66d60 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-6f5b65aa-0874-4305-ac4e-292af80371d5 req-9bd85008-12c8-4843-a0ae-31b4bde66d60 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:29 user nova-compute[82184]: WARNING nova.compute.manager [req-6f5b65aa-0874-4305-ac4e-292af80371d5 req-9bd85008-12c8-4843-a0ae-31b4bde66d60 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 for instance with vm_state building and task_state spawning.
Apr 12 01:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-80d64e34-c1d8-4952-8f65-53a7dc22f3ad req-31686057-6cd8-4fc6-b512-11195b9c451e service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-80d64e34-c1d8-4952-8f65-53a7dc22f3ad req-31686057-6cd8-4fc6-b512-11195b9c451e service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-80d64e34-c1d8-4952-8f65-53a7dc22f3ad req-31686057-6cd8-4fc6-b512-11195b9c451e service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-80d64e34-c1d8-4952-8f65-53a7dc22f3ad req-31686057-6cd8-4fc6-b512-11195b9c451e service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-80d64e34-c1d8-4952-8f65-53a7dc22f3ad req-31686057-6cd8-4fc6-b512-11195b9c451e service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:30 user nova-compute[82184]: WARNING nova.compute.manager [req-80d64e34-c1d8-4952-8f65-53a7dc22f3ad req-31686057-6cd8-4fc6-b512-11195b9c451e service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 for instance with vm_state building and task_state spawning.
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:31 user nova-compute[82184]: WARNING nova.compute.manager [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-69bce85f-9dda-4202-a608-f9c4da0cff43 for instance with vm_state building and task_state spawning.
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:31 user nova-compute[82184]: WARNING nova.compute.manager [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-1834b43d-230e-4d08-8980-3415727f8b44 for instance with vm_state building and task_state spawning.
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:31 user nova-compute[82184]: WARNING nova.compute.manager [req-8fb1c2bd-a035-4f08-af76-179cdaee1e00 req-382a8477-5e90-4f3a-a165-445b96546ff5 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-1834b43d-230e-4d08-8980-3415727f8b44 for instance with vm_state building and task_state spawning.
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:31 user nova-compute[82184]: WARNING nova.compute.manager [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 for instance with vm_state building and task_state spawning.
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:31 user nova-compute[82184]: WARNING nova.compute.manager [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 for instance with vm_state building and task_state spawning.
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:31 user nova-compute[82184]: WARNING nova.compute.manager [req-2e32e494-39ce-43cf-9afa-f9df39f29d44 req-ecd59969-200f-4887-87a0-f5fe5e5fd687 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 for instance with vm_state building and task_state spawning.
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:32 user nova-compute[82184]: WARNING nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-3862628b-e679-40e9-ba14-5aaab53bb289 for instance with vm_state building and task_state spawning.
Apr 12 01:51:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:32 user nova-compute[82184]: WARNING nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-3862628b-e679-40e9-ba14-5aaab53bb289 for instance with vm_state building and task_state spawning.
Apr 12 01:51:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:32 user nova-compute[82184]: WARNING nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f for instance with vm_state building and task_state spawning.
Apr 12 01:51:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:32 user nova-compute[82184]: WARNING nova.compute.manager [req-3682ebaf-0fa3-4efc-98c1-23fb0ab80258 req-4cb49a14-944b-4939-97c1-2718b2559b4a service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f for instance with vm_state building and task_state spawning.
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:33 user nova-compute[82184]: WARNING nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-890247d7-ec5c-429e-beef-5666b669f4f3 for instance with vm_state building and task_state spawning.
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:33 user nova-compute[82184]: WARNING nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-890247d7-ec5c-429e-beef-5666b669f4f3 for instance with vm_state building and task_state spawning.
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:33 user nova-compute[82184]: WARNING nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 for instance with vm_state building and task_state spawning.
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:33 user nova-compute[82184]: WARNING nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 for instance with vm_state building and task_state spawning.
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:33 user nova-compute[82184]: WARNING nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 for instance with vm_state building and task_state spawning.
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:33 user nova-compute[82184]: WARNING nova.compute.manager [req-8e146797-3f8d-4efd-86ff-b1e370109459 req-b84d4278-d385-4c71-a93f-a6367590ea07 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 for instance with vm_state building and task_state spawning.
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-df8f08f0-8676-4f76-aaf4-3d1164249013 req-7966a1e8-0ff1-4dfb-9e47-2050cb72b88a service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-df8f08f0-8676-4f76-aaf4-3d1164249013 req-7966a1e8-0ff1-4dfb-9e47-2050cb72b88a service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-df8f08f0-8676-4f76-aaf4-3d1164249013 req-7966a1e8-0ff1-4dfb-9e47-2050cb72b88a service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-df8f08f0-8676-4f76-aaf4-3d1164249013 req-7966a1e8-0ff1-4dfb-9e47-2050cb72b88a service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-df8f08f0-8676-4f76-aaf4-3d1164249013 req-7966a1e8-0ff1-4dfb-9e47-2050cb72b88a service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:33 user nova-compute[82184]: WARNING nova.compute.manager [req-df8f08f0-8676-4f76-aaf4-3d1164249013 req-7966a1e8-0ff1-4dfb-9e47-2050cb72b88a service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 for instance with vm_state building and task_state spawning.
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264294.6284223, 59c7c418-902e-46b7-9302-5c630df18ca2 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:51:34 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] VM Resumed (Lifecycle Event)
Apr 12 01:51:34 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Instance spawned successfully.
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:34 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264294.636901, 59c7c418-902e-46b7-9302-5c630df18ca2 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:51:34 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] VM Started (Lifecycle Event)
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:34 user nova-compute[82184]: WARNING nova.compute.manager [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 for instance with vm_state building and task_state spawning.
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:34 user nova-compute[82184]: WARNING nova.compute.manager [req-11536a1c-caff-4687-9b97-b69839fdcbd9 req-93f2d1b3-8f8d-4a45-aaee-cd916faf9bb0 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 for instance with vm_state building and task_state spawning.
Apr 12 01:51:34 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:51:34 user nova-compute[82184]: INFO nova.compute.manager [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Took 15.31 seconds to spawn the instance on the hypervisor.
Apr 12 01:51:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:34 user nova-compute[82184]: INFO nova.compute.manager [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Took 39.89 seconds to build instance.
Apr 12 01:51:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5105616e-60ff-4963-bf48-503d3b22ddc7 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "59c7c418-902e-46b7-9302-5c630df18ca2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.996s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:35 user nova-compute[82184]: WARNING nova.compute.manager [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 for instance with vm_state building and task_state spawning.
Apr 12 01:51:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:35 user nova-compute[82184]: WARNING nova.compute.manager [req-3b5a7794-1aa1-4b7f-969f-757f54670d44 req-c46deae6-0621-431e-afd6-016f64a894b6 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 for instance with vm_state building and task_state spawning.
Apr 12 01:51:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:35 user nova-compute[82184]: WARNING nova.compute.manager [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 for instance with vm_state building and task_state spawning.
Apr 12 01:51:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:35 user nova-compute[82184]: WARNING nova.compute.manager [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f for instance with vm_state building and task_state spawning.
Apr 12 01:51:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:35 user nova-compute[82184]: WARNING nova.compute.manager [req-aed2017f-da1b-4f11-b9f1-8202d8cce215 req-c23ae1b4-3ef9-49d7-ae18-92e1bf6c1873 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f for instance with vm_state building and task_state spawning.
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264296.0013516, 221e01f2-18c8-468b-993b-480cdda60dd7 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:51:36 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] VM Resumed (Lifecycle Event)
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:51:36 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance spawned successfully.
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:36 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264296.0029027, 221e01f2-18c8-468b-993b-480cdda60dd7 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:51:36 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] VM Started (Lifecycle Event)
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:51:36 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:51:36 user nova-compute[82184]: INFO nova.compute.manager [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Took 15.41 seconds to spawn the instance on the hypervisor.
Apr 12 01:51:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:36 user nova-compute[82184]: INFO nova.compute.manager [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Took 43.17 seconds to build instance.
Apr 12 01:51:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c8d857cb-ed37-491c-a549-51dd4134ba55 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "221e01f2-18c8-468b-993b-480cdda60dd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.260s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.006s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:51:40 user nova-compute[82184]: INFO nova.compute.manager [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Rescuing
Apr 12 01:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquired lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:40 user nova-compute[82184]: DEBUG nova.network.neutron [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-8c595e5e-9df8-4361-93c0-a78129f83c93 req-908b7efd-0b40-4310-baf2-2603d2412333 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-changed-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-8c595e5e-9df8-4361-93c0-a78129f83c93 req-908b7efd-0b40-4310-baf2-2603d2412333 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Refreshing instance network info cache due to event network-changed-365b7a91-793f-4aaf-af62-4e1c45d300e8. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c595e5e-9df8-4361-93c0-a78129f83c93 req-908b7efd-0b40-4310-baf2-2603d2412333 service nova] Acquiring lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c595e5e-9df8-4361-93c0-a78129f83c93 req-908b7efd-0b40-4310-baf2-2603d2412333 service nova] Acquired lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG nova.network.neutron [req-8c595e5e-9df8-4361-93c0-a78129f83c93 req-908b7efd-0b40-4310-baf2-2603d2412333 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Refreshing network info cache for port 365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG nova.network.neutron [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updating instance_info_cache with network_info: [{"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Releasing lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG nova.network.neutron [req-8c595e5e-9df8-4361-93c0-a78129f83c93 req-908b7efd-0b40-4310-baf2-2603d2412333 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updated VIF entry in instance network info cache for port 365b7a91-793f-4aaf-af62-4e1c45d300e8. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG nova.network.neutron [req-8c595e5e-9df8-4361-93c0-a78129f83c93 req-908b7efd-0b40-4310-baf2-2603d2412333 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c595e5e-9df8-4361-93c0-a78129f83c93 req-908b7efd-0b40-4310-baf2-2603d2412333 service nova] Releasing lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "2f32ace1-1adc-4b75-a1cc-daac2e724846" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:43 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Instance destroyed successfully.
Apr 12 01:51:43 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Attempting rescue
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Instance directory exists: not creating {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 01:51:43 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Creating image(s)
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'trusted_certs' on Instance uuid d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:51:43 user nova-compute[82184]: INFO nova.compute.claims [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Claim successful on node user
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue" returned: 0 in 0.060s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'migration_context' on Instance uuid d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Start _get_guest_xml network_info=[{"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "vif_mac": "fa:16:3e:8d:3b:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'resources' on Instance uuid d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'numa_topology' on Instance uuid d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:43 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:51:43 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'vcpu_model' on Instance uuid d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-808158946',display_name='tempest-ServerRescueNegativeTestJSON-server-808158946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-808158946',id=3,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-v56w4pkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:11Z,user_data=None,user_id='889189da060e4b54a48ce9a013e04a3d',uuid=d5c21fac-9fd9-46f8-851e-d1727f5ab0b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "vif_mac": "fa:16:3e:8d:3b:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "vif_mac": "fa:16:3e:8d:3b:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3b:63,bridge_name='br-int',has_traffic_filtering=True,id=7edd32c8-a71c-4552-bb85-a073a178f87d,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edd32c8-a7') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'pci_devices' on Instance uuid d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:51:43 user nova-compute[82184]:   <uuid>d5c21fac-9fd9-46f8-851e-d1727f5ab0b9</uuid>
Apr 12 01:51:43 user nova-compute[82184]:   <name>instance-00000003</name>
Apr 12 01:51:43 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:51:43 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:51:43 user nova-compute[82184]:   <metadata>
Apr 12 01:51:43 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:51:43 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:51:43 user nova-compute[82184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-808158946</nova:name>
Apr 12 01:51:43 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:51:43</nova:creationTime>
Apr 12 01:51:43 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:51:43 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:51:43 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:51:43 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:51:43 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:51:43 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:51:43 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:51:43 user nova-compute[82184]:       <nova:owner>
Apr 12 01:51:43 user nova-compute[82184]:         <nova:user uuid="889189da060e4b54a48ce9a013e04a3d">tempest-ServerRescueNegativeTestJSON-502185932-project-member</nova:user>
Apr 12 01:51:43 user nova-compute[82184]:         <nova:project uuid="8fed0886b2404f41a659dc6356771e9c">tempest-ServerRescueNegativeTestJSON-502185932</nova:project>
Apr 12 01:51:43 user nova-compute[82184]:       </nova:owner>
Apr 12 01:51:43 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:51:43 user nova-compute[82184]:       <nova:ports>
Apr 12 01:51:43 user nova-compute[82184]:         <nova:port uuid="7edd32c8-a71c-4552-bb85-a073a178f87d">
Apr 12 01:51:43 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 01:51:43 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:43 user nova-compute[82184]:       </nova:ports>
Apr 12 01:51:43 user nova-compute[82184]:     </nova:instance>
Apr 12 01:51:43 user nova-compute[82184]:   </metadata>
Apr 12 01:51:43 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:51:43 user nova-compute[82184]:     <system>
Apr 12 01:51:43 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:51:43 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:51:43 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:51:43 user nova-compute[82184]:       <entry name="serial">d5c21fac-9fd9-46f8-851e-d1727f5ab0b9</entry>
Apr 12 01:51:43 user nova-compute[82184]:       <entry name="uuid">d5c21fac-9fd9-46f8-851e-d1727f5ab0b9</entry>
Apr 12 01:51:43 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:51:43 user nova-compute[82184]:     </system>
Apr 12 01:51:43 user nova-compute[82184]:   </sysinfo>
Apr 12 01:51:43 user nova-compute[82184]:   <os>
Apr 12 01:51:43 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:51:43 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:51:43 user nova-compute[82184]:   </os>
Apr 12 01:51:43 user nova-compute[82184]:   <features>
Apr 12 01:51:43 user nova-compute[82184]:     <acpi/>
Apr 12 01:51:43 user nova-compute[82184]:     <apic/>
Apr 12 01:51:43 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:51:43 user nova-compute[82184]:   </features>
Apr 12 01:51:43 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:51:43 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:51:43 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:51:43 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:51:43 user nova-compute[82184]:   </clock>
Apr 12 01:51:43 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:51:43 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:51:43 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:51:43 user nova-compute[82184]:   </cpu>
Apr 12 01:51:43 user nova-compute[82184]:   <devices>
Apr 12 01:51:43 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:51:43 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:51:43 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue"/>
Apr 12 01:51:43 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:51:43 user nova-compute[82184]:     </disk>
Apr 12 01:51:43 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:51:43 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:51:43 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk"/>
Apr 12 01:51:43 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 01:51:43 user nova-compute[82184]:     </disk>
Apr 12 01:51:43 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:43 user nova-compute[82184]:       <mac address="fa:16:3e:8d:3b:63"/>
Apr 12 01:51:43 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:43 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:43 user nova-compute[82184]:       <target dev="tap7edd32c8-a7"/>
Apr 12 01:51:43 user nova-compute[82184]:     </interface>
Apr 12 01:51:43 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:51:43 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/console.log" append="off"/>
Apr 12 01:51:43 user nova-compute[82184]:     </serial>
Apr 12 01:51:43 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:51:43 user nova-compute[82184]:     <video>
Apr 12 01:51:43 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:43 user nova-compute[82184]:     </video>
Apr 12 01:51:43 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:51:43 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:51:43 user nova-compute[82184]:     </rng>
Apr 12 01:51:43 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:51:43 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:51:43 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:51:43 user nova-compute[82184]:     </memballoon>
Apr 12 01:51:43 user nova-compute[82184]:   </devices>
Apr 12 01:51:43 user nova-compute[82184]: </domain>
Apr 12 01:51:43 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:43 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Instance destroyed successfully.
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No VIF found with MAC fa:16:3e:8d:3b:63, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.757s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-vif-unplugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] No waiting events found dispatching network-vif-unplugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:43 user nova-compute[82184]: WARNING nova.compute.manager [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received unexpected event network-vif-unplugged-7edd32c8-a71c-4552-bb85-a073a178f87d for instance with vm_state active and task_state rescuing.
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] No waiting events found dispatching network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:43 user nova-compute[82184]: WARNING nova.compute.manager [req-c59a51e8-f4c3-4cd3-b4ec-2e72bff3eece req-e47db366-4c49-4f4b-9ae8-34313b5c9f3a service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received unexpected event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d for instance with vm_state active and task_state rescuing.
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG nova.network.neutron [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:51:43 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:51:44 user nova-compute[82184]: DEBUG nova.policy [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '728c534ef1f54c50ad2b619b44c3b9c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021f9aee2b7849ef8fcd67d6d6522d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:51:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:51:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:51:44 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Creating image(s)
Apr 12 01:51:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "/opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "/opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Successfully created port: 98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] No waiting events found dispatching network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:48 user nova-compute[82184]: WARNING nova.compute.manager [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received unexpected event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d for instance with vm_state active and task_state rescuing.
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] No waiting events found dispatching network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:48 user nova-compute[82184]: WARNING nova.compute.manager [req-56859869-d555-4518-a3e1-c33c3989f1a1 req-a3cd267b-048a-4f37-88a2-dbc1a8238637 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received unexpected event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d for instance with vm_state active and task_state rescuing.
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-17ad661f-2d0d-45f5-94ee-f7b637a8d24d req-490e7fc1-394a-49c0-a14d-555eda23b201 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-changed-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-17ad661f-2d0d-45f5-94ee-f7b637a8d24d req-490e7fc1-394a-49c0-a14d-555eda23b201 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Refreshing instance network info cache due to event network-changed-ec368fc5-6d05-4bab-8460-cf9f1e024195. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-17ad661f-2d0d-45f5-94ee-f7b637a8d24d req-490e7fc1-394a-49c0-a14d-555eda23b201 service nova] Acquiring lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-17ad661f-2d0d-45f5-94ee-f7b637a8d24d req-490e7fc1-394a-49c0-a14d-555eda23b201 service nova] Acquired lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.network.neutron [req-17ad661f-2d0d-45f5-94ee-f7b637a8d24d req-490e7fc1-394a-49c0-a14d-555eda23b201 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Refreshing network info cache for port ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264307.497305, d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:51:48 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] VM Resumed (Lifecycle Event)
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 3.908s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-96121c63-7660-4561-aa63-984cc88f0361 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lazy-loading 'flavor' on Instance uuid 371f55da-306a-4ef9-b04f-7c22e8071e5c {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:48 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:51:48 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=7418MB free_disk=26.583812713623047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:51:48 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264307.4990642, d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:51:48 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] VM Started (Lifecycle Event)
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.177s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:48 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.207s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk 1073741824" returned: 0 in 0.083s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2f32ace1-1adc-4b75-a1cc-daac2e724846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 371f55da-306a-4ef9-b04f-7c22e8071e5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 221e01f2-18c8-468b-993b-480cdda60dd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance f2eedf78-0fd6-4cc1-8efd-50958e07fde6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 59c7c418-902e-46b7-9302-5c630df18ca2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cb89325c-680a-4413-8e94-4eddfaa79c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.173s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:48 user nova-compute[82184]: INFO nova.compute.manager [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Attaching volume b9fb6599-c30a-4a61-ab9b-ae62affb4857 to /dev/vdb
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Cannot resize image /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.objects.instance [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lazy-loading 'migration_context' on Instance uuid 2f32ace1-1adc-4b75-a1cc-daac2e724846 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Ensure instance console log exists: /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG os_brick.utils [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1936b7ec-31aa-47c3-9c0f-1224346ba03a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b0dd70-fdbd-4dce-8519-f9e6786e9a63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2287d78-e076-4f25-b749-3b1d8c81fe52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c62ba5-4c1c-4947-9007-dec6faea8bdc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:49 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[131eccef-636c-4271-9b8a-10a1bbdc52f7]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.utils [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Updating existing volume attachment record: 4f65336f-ee0c-44ac-b4d2-972120822d9b {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Successfully updated port: 98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "refresh_cache-2f32ace1-1adc-4b75-a1cc-daac2e724846" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquired lock "refresh_cache-2f32ace1-1adc-4b75-a1cc-daac2e724846" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-17ad661f-2d0d-45f5-94ee-f7b637a8d24d req-490e7fc1-394a-49c0-a14d-555eda23b201 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updated VIF entry in instance network info cache for port ec368fc5-6d05-4bab-8460-cf9f1e024195. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-17ad661f-2d0d-45f5-94ee-f7b637a8d24d req-490e7fc1-394a-49c0-a14d-555eda23b201 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updating instance_info_cache with network_info: [{"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-17ad661f-2d0d-45f5-94ee-f7b637a8d24d req-490e7fc1-394a-49c0-a14d-555eda23b201 service nova] Releasing lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.163s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.058s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-a458b47c-eea5-4267-b24e-6bba9c2fed2b req-74daab3a-6015-4f9d-b778-53b4b57e24db service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Received event network-changed-98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-a458b47c-eea5-4267-b24e-6bba9c2fed2b req-74daab3a-6015-4f9d-b778-53b4b57e24db service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Refreshing instance network info cache due to event network-changed-98ce60a7-28d6-42db-8002-f433bd77175e. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a458b47c-eea5-4267-b24e-6bba9c2fed2b req-74daab3a-6015-4f9d-b778-53b4b57e24db service nova] Acquiring lock "refresh_cache-2f32ace1-1adc-4b75-a1cc-daac2e724846" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:49 user nova-compute[82184]: INFO nova.compute.manager [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Attaching volume 52725f14-a644-4019-b7c6-9547d83cfb1b to /dev/vdb
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Updating instance_info_cache with network_info: [{"id": "98ce60a7-28d6-42db-8002-f433bd77175e", "address": "fa:16:3e:7f:4a:00", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ce60a7-28", "ovs_interfaceid": "98ce60a7-28d6-42db-8002-f433bd77175e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.utils [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Releasing lock "refresh_cache-2f32ace1-1adc-4b75-a1cc-daac2e724846" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Instance network_info: |[{"id": "98ce60a7-28d6-42db-8002-f433bd77175e", "address": "fa:16:3e:7f:4a:00", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ce60a7-28", "ovs_interfaceid": "98ce60a7-28d6-42db-8002-f433bd77175e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a458b47c-eea5-4267-b24e-6bba9c2fed2b req-74daab3a-6015-4f9d-b778-53b4b57e24db service nova] Acquired lock "refresh_cache-2f32ace1-1adc-4b75-a1cc-daac2e724846" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-a458b47c-eea5-4267-b24e-6bba9c2fed2b req-74daab3a-6015-4f9d-b778-53b4b57e24db service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Refreshing network info cache for port 98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Start _get_guest_xml network_info=[{"id": "98ce60a7-28d6-42db-8002-f433bd77175e", "address": "fa:16:3e:7f:4a:00", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ce60a7-28", "ovs_interfaceid": "98ce60a7-28d6-42db-8002-f433bd77175e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[633c771c-b4c6-4834-8ca3-631fda036c05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:49 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:51:49 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1705395768',display_name='tempest-ServersNegativeTestJSON-server-1705395768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1705395768',id=12,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='021f9aee2b7849ef8fcd67d6d6522d27',ramdisk_id='',reservation_id='r-wulg0dap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-292036935',owner_user_name='tempest-ServersNegativeTestJSON-292036935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:51:44Z,user_data=None,user_id='728c534ef1f54c50ad2b619b44c3b9c7',uuid=2f32ace1-1adc-4b75-a1cc-daac2e724846,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98ce60a7-28d6-42db-8002-f433bd77175e", "address": "fa:16:3e:7f:4a:00", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ce60a7-28", "ovs_interfaceid": "98ce60a7-28d6-42db-8002-f433bd77175e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converting VIF {"id": "98ce60a7-28d6-42db-8002-f433bd77175e", "address": "fa:16:3e:7f:4a:00", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ce60a7-28", "ovs_interfaceid": "98ce60a7-28d6-42db-8002-f433bd77175e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:4a:00,bridge_name='br-int',has_traffic_filtering=True,id=98ce60a7-28d6-42db-8002-f433bd77175e,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ce60a7-28') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f32ace1-1adc-4b75-a1cc-daac2e724846 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54044a20-5cd7-4e2f-bd1c-35e049b40046]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:51:49 user nova-compute[82184]:   <uuid>2f32ace1-1adc-4b75-a1cc-daac2e724846</uuid>
Apr 12 01:51:49 user nova-compute[82184]:   <name>instance-0000000c</name>
Apr 12 01:51:49 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:51:49 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:51:49 user nova-compute[82184]:   <metadata>
Apr 12 01:51:49 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:51:49 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:51:49 user nova-compute[82184]:       <nova:name>tempest-ServersNegativeTestJSON-server-1705395768</nova:name>
Apr 12 01:51:49 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:51:49</nova:creationTime>
Apr 12 01:51:49 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:51:49 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:51:49 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:51:49 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:51:49 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:51:49 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:51:49 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:51:49 user nova-compute[82184]:       <nova:owner>
Apr 12 01:51:49 user nova-compute[82184]:         <nova:user uuid="728c534ef1f54c50ad2b619b44c3b9c7">tempest-ServersNegativeTestJSON-292036935-project-member</nova:user>
Apr 12 01:51:49 user nova-compute[82184]:         <nova:project uuid="021f9aee2b7849ef8fcd67d6d6522d27">tempest-ServersNegativeTestJSON-292036935</nova:project>
Apr 12 01:51:49 user nova-compute[82184]:       </nova:owner>
Apr 12 01:51:49 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:51:49 user nova-compute[82184]:       <nova:ports>
Apr 12 01:51:49 user nova-compute[82184]:         <nova:port uuid="98ce60a7-28d6-42db-8002-f433bd77175e">
Apr 12 01:51:49 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 01:51:49 user nova-compute[82184]:         </nova:port>
Apr 12 01:51:49 user nova-compute[82184]:       </nova:ports>
Apr 12 01:51:49 user nova-compute[82184]:     </nova:instance>
Apr 12 01:51:49 user nova-compute[82184]:   </metadata>
Apr 12 01:51:49 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:51:49 user nova-compute[82184]:     <system>
Apr 12 01:51:49 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:51:49 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:51:49 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:51:49 user nova-compute[82184]:       <entry name="serial">2f32ace1-1adc-4b75-a1cc-daac2e724846</entry>
Apr 12 01:51:49 user nova-compute[82184]:       <entry name="uuid">2f32ace1-1adc-4b75-a1cc-daac2e724846</entry>
Apr 12 01:51:49 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:51:49 user nova-compute[82184]:     </system>
Apr 12 01:51:49 user nova-compute[82184]:   </sysinfo>
Apr 12 01:51:49 user nova-compute[82184]:   <os>
Apr 12 01:51:49 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:51:49 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:51:49 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:51:49 user nova-compute[82184]:   </os>
Apr 12 01:51:49 user nova-compute[82184]:   <features>
Apr 12 01:51:49 user nova-compute[82184]:     <acpi/>
Apr 12 01:51:49 user nova-compute[82184]:     <apic/>
Apr 12 01:51:49 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:51:49 user nova-compute[82184]:   </features>
Apr 12 01:51:49 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:51:49 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:51:49 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:51:49 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:51:49 user nova-compute[82184]:   </clock>
Apr 12 01:51:49 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:51:49 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:51:49 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:51:49 user nova-compute[82184]:   </cpu>
Apr 12 01:51:49 user nova-compute[82184]:   <devices>
Apr 12 01:51:49 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:51:49 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:51:49 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk"/>
Apr 12 01:51:49 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:51:49 user nova-compute[82184]:     </disk>
Apr 12 01:51:49 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:51:49 user nova-compute[82184]:       <mac address="fa:16:3e:7f:4a:00"/>
Apr 12 01:51:49 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:49 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:51:49 user nova-compute[82184]:       <target dev="tap98ce60a7-28"/>
Apr 12 01:51:49 user nova-compute[82184]:     </interface>
Apr 12 01:51:49 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:51:49 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/console.log" append="off"/>
Apr 12 01:51:49 user nova-compute[82184]:     </serial>
Apr 12 01:51:49 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:51:49 user nova-compute[82184]:     <video>
Apr 12 01:51:49 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:51:49 user nova-compute[82184]:     </video>
Apr 12 01:51:49 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:51:49 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:51:49 user nova-compute[82184]:     </rng>
Apr 12 01:51:49 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:51:49 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:51:49 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:51:49 user nova-compute[82184]:     </memballoon>
Apr 12 01:51:49 user nova-compute[82184]:   </devices>
Apr 12 01:51:49 user nova-compute[82184]: </domain>
Apr 12 01:51:49 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1705395768',display_name='tempest-ServersNegativeTestJSON-server-1705395768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1705395768',id=12,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='021f9aee2b7849ef8fcd67d6d6522d27',ramdisk_id='',reservation_id='r-wulg0dap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-292036935',owner_user_name='tempest-ServersNegativeTestJSON-292036935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:51:44Z,user_data=None,user_id='728c534ef1f54c50ad2b619b44c3b9c7',uuid=2f32ace1-1adc-4b75-a1cc-daac2e724846,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98ce60a7-28d6-42db-8002-f433bd77175e", "address": "fa:16:3e:7f:4a:00", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ce60a7-28", "ovs_interfaceid": "98ce60a7-28d6-42db-8002-f433bd77175e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converting VIF {"id": "98ce60a7-28d6-42db-8002-f433bd77175e", "address": "fa:16:3e:7f:4a:00", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ce60a7-28", "ovs_interfaceid": "98ce60a7-28d6-42db-8002-f433bd77175e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:4a:00,bridge_name='br-int',has_traffic_filtering=True,id=98ce60a7-28d6-42db-8002-f433bd77175e,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ce60a7-28') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_vif [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:4a:00,bridge_name='br-int',has_traffic_filtering=True,id=98ce60a7-28d6-42db-8002-f433bd77175e,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ce60a7-28') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98ce60a7-28, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap98ce60a7-28, col_values=(('external_ids', {'iface-id': '98ce60a7-28d6-42db-8002-f433bd77175e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:4a:00', 'vm-uuid': '2f32ace1-1adc-4b75-a1cc-daac2e724846'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00dafd6-8ac2-481d-9a80-2e973dc2ee64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd74360-3ab0-40c4-8ed5-a5dc93dde86c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:51:49 user nova-compute[82184]: INFO os_vif [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:4a:00,bridge_name='br-int',has_traffic_filtering=True,id=98ce60a7-28d6-42db-8002-f433bd77175e,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ce60a7-28')
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:51:49 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:51:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06c4ad7-54aa-4e3a-b216-06d0c7437d25]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG os_brick.utils [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updating existing volume attachment record: b23c2333-9f0a-46dc-8892-286620eddc00 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] No VIF found with MAC fa:16:3e:7f:4a:00, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG nova.network.neutron [req-a458b47c-eea5-4267-b24e-6bba9c2fed2b req-74daab3a-6015-4f9d-b778-53b4b57e24db service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Updated VIF entry in instance network info cache for port 98ce60a7-28d6-42db-8002-f433bd77175e. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG nova.network.neutron [req-a458b47c-eea5-4267-b24e-6bba9c2fed2b req-74daab3a-6015-4f9d-b778-53b4b57e24db service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Updating instance_info_cache with network_info: [{"id": "98ce60a7-28d6-42db-8002-f433bd77175e", "address": "fa:16:3e:7f:4a:00", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ce60a7-28", "ovs_interfaceid": "98ce60a7-28d6-42db-8002-f433bd77175e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a458b47c-eea5-4267-b24e-6bba9c2fed2b req-74daab3a-6015-4f9d-b778-53b4b57e24db service nova] Releasing lock "refresh_cache-2f32ace1-1adc-4b75-a1cc-daac2e724846" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:51:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:51:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-ab30c288-6949-4cf7-b0de-cbaa6d6c2290 req-554a937b-c291-44af-9bab-1cc21f5039d7 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Received event network-vif-plugged-98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ab30c288-6949-4cf7-b0de-cbaa6d6c2290 req-554a937b-c291-44af-9bab-1cc21f5039d7 service nova] Acquiring lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ab30c288-6949-4cf7-b0de-cbaa6d6c2290 req-554a937b-c291-44af-9bab-1cc21f5039d7 service nova] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ab30c288-6949-4cf7-b0de-cbaa6d6c2290 req-554a937b-c291-44af-9bab-1cc21f5039d7 service nova] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-ab30c288-6949-4cf7-b0de-cbaa6d6c2290 req-554a937b-c291-44af-9bab-1cc21f5039d7 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] No waiting events found dispatching network-vif-plugged-98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:51 user nova-compute[82184]: WARNING nova.compute.manager [req-ab30c288-6949-4cf7-b0de-cbaa6d6c2290 req-554a937b-c291-44af-9bab-1cc21f5039d7 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Received unexpected event network-vif-plugged-98ce60a7-28d6-42db-8002-f433bd77175e for instance with vm_state building and task_state spawning.
Apr 12 01:51:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264313.6333022, 2f32ace1-1adc-4b75-a1cc-daac2e724846 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:51:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] VM Resumed (Lifecycle Event)
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:51:53 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Instance spawned successfully.
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-698aada5-734d-45a9-962d-72c54eb0fd12 req-2a37b225-c566-4ea5-818c-4cbe23c5ce68 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Received event network-vif-plugged-98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-698aada5-734d-45a9-962d-72c54eb0fd12 req-2a37b225-c566-4ea5-818c-4cbe23c5ce68 service nova] Acquiring lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-698aada5-734d-45a9-962d-72c54eb0fd12 req-2a37b225-c566-4ea5-818c-4cbe23c5ce68 service nova] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-698aada5-734d-45a9-962d-72c54eb0fd12 req-2a37b225-c566-4ea5-818c-4cbe23c5ce68 service nova] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-698aada5-734d-45a9-962d-72c54eb0fd12 req-2a37b225-c566-4ea5-818c-4cbe23c5ce68 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] No waiting events found dispatching network-vif-plugged-98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:53 user nova-compute[82184]: WARNING nova.compute.manager [req-698aada5-734d-45a9-962d-72c54eb0fd12 req-2a37b225-c566-4ea5-818c-4cbe23c5ce68 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Received unexpected event network-vif-plugged-98ce60a7-28d6-42db-8002-f433bd77175e for instance with vm_state building and task_state spawning.
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:51:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264313.635383, 2f32ace1-1adc-4b75-a1cc-daac2e724846 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:51:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] VM Started (Lifecycle Event)
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:51:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:51:53 user nova-compute[82184]: INFO nova.compute.manager [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Took 9.62 seconds to spawn the instance on the hypervisor.
Apr 12 01:51:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:53 user nova-compute[82184]: INFO nova.compute.manager [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Took 10.86 seconds to build instance.
Apr 12 01:51:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-322b2e37-c7be-4630-b267-06577668094e tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.044s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mSZCYyKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:54 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:54 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:54 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f2cd15-0fad-4bc2-a5ec-35250b414ba0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:51:54 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5edb981-b9a1-4848-b934-8e6c36eb9de3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857] added
Apr 12 01:51:54 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb571765-ec00-4e7d-87e1-f79b7612cf4a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfc82c6-11dc-48de-a703-e7f8e8851e35]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mSZCYyKi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mSZCYyKi" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ff24f3-ee97-4b9a-8bdd-b3e5ad07ce9a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mSZCYyKi'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24212986-e331-4319-9bb6-c093c58b6540]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e71bf-a8be-4998-be48-08ab2c12fe47]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:54 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:54 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[53182cbc-a92f-4505-a2dc-251c1077db60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857, portal: 172.16.0.220,3260]
Apr 12 01:51:54 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857, portal: 172.16.0.220,3260] successful.
Apr 12 01:51:54 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fa5fd5-115f-42b3-b1e4-5f2ee255d83e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b66e7ee-b8cf-4926-86b3-d84cea34fcf4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:54 user nova-compute[82184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)
Apr 12 01:51:54 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6ac6d3-c117-4a3b-ba9d-699d839f92fd]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mSZCYyKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWTrRDKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:54 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23762376264343133', 'path': '/dev/sdh'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762376264343133', 'path': '/dev/sdh'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.831s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:55 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:55 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lazy-loading 'flavor' on Instance uuid 371f55da-306a-4ef9-b04f-7c22e8071e5c {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da7f383-b54b-4378-96fa-6e9a59308f69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:51:55 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:51:55 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:51:55 user nova-compute[82184]:   <source dev="/dev/sdh"/>
Apr 12 01:51:55 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:51:55 user nova-compute[82184]:   <serial>b9fb6599-c30a-4a61-ab9b-ae62affb4857</serial>
Apr 12 01:51:55 user nova-compute[82184]: </disk>
Apr 12 01:51:55 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c915df3-3e2c-457a-83ec-fa32bff2fd69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b] added
Apr 12 01:51:55 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac31ed7-5b8d-4970-8fdc-fac8ffbf4638]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1454ab4a-8cb7-42f0-bbe4-efcaa997ea00]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWTrRDKA {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWTrRDKA" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8327a38d-b4cf-46ff-93c3-df480ac90687]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWTrRDKA'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[109bf035-c998-4830-b09f-f3ebf6336d9d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[db89c10f-2798-462b-b374-62da4bd1c85d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d5011a-3248-47a1-b841-3774a64d6117]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260]
Apr 12 01:51:55 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260] successful.
Apr 12 01:51:55 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2891b99-165c-4d68-bdcc-01f36d436630]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[956aea8d-88dc-4732-87bb-cecc2448edaf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:51:55 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)
Apr 12 01:51:55 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:51:55 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e20b67-fb6c-4334-b1a3-89c1f1a6c079]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:55 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:51:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWTrRDKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:51:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] No VIF found with MAC fa:16:3e:79:68:d8, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:51:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a1b5cab-304f-446e-a918-d70b6dd613a9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.501s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== connect_volume: return (2249ms) {'type': 'block', 'scsi_wwn': '26235653533653762', 'path': '/dev/sdi'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235653533653762', 'path': '/dev/sdi'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:51:57 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:51:57 user nova-compute[82184]:   <source dev="/dev/sdi"/>
Apr 12 01:51:57 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:51:57 user nova-compute[82184]:   <serial>52725f14-a644-4019-b7c6-9547d83cfb1b</serial>
Apr 12 01:51:57 user nova-compute[82184]: </disk>
Apr 12 01:51:57 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No VIF found with MAC fa:16:3e:9d:cb:06, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81d76f90-d832-4023-b3b1-8e31cd0c71de tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.200s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:57 user nova-compute[82184]: INFO nova.compute.manager [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Terminating instance
Apr 12 01:51:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-c6863eb5-1fd7-4118-bdad-250a876444e9 req-680388fc-b58e-4ccb-a9f6-759322ae28c9 service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Received event network-vif-unplugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6863eb5-1fd7-4118-bdad-250a876444e9 req-680388fc-b58e-4ccb-a9f6-759322ae28c9 service nova] Acquiring lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6863eb5-1fd7-4118-bdad-250a876444e9 req-680388fc-b58e-4ccb-a9f6-759322ae28c9 service nova] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6863eb5-1fd7-4118-bdad-250a876444e9 req-680388fc-b58e-4ccb-a9f6-759322ae28c9 service nova] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-c6863eb5-1fd7-4118-bdad-250a876444e9 req-680388fc-b58e-4ccb-a9f6-759322ae28c9 service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] No waiting events found dispatching network-vif-unplugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-c6863eb5-1fd7-4118-bdad-250a876444e9 req-680388fc-b58e-4ccb-a9f6-759322ae28c9 service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Received event network-vif-unplugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-39d8cb83-0db3-4a02-a9ac-4da96c12cdd2 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-39d8cb83-0db3-4a02-a9ac-4da96c12cdd2 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-39d8cb83-0db3-4a02-a9ac-4da96c12cdd2 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-39d8cb83-0db3-4a02-a9ac-4da96c12cdd2 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82184) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.objects.instance [None req-39d8cb83-0db3-4a02-a9ac-4da96c12cdd2 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:58 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Instance destroyed successfully.
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.objects.instance [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lazy-loading 'resources' on Instance uuid 371f55da-306a-4ef9-b04f-7c22e8071e5c {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-494306683',display_name='tempest-DeleteServersTestJSON-server-494306683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-494306683',id=5,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a7713a76bb546d2a348927f18b12eb7',ramdisk_id='',reservation_id='r-9sxho75h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-986135774',owner_user_name='tempest-DeleteServersTestJSON-986135774-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:50:11Z,user_data=None,user_id='6c503a0141cf4794bf4e6faba59bdba3',uuid=371f55da-306a-4ef9-b04f-7c22e8071e5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "address": "fa:16:3e:79:68:d8", "network": {"id": "0ef60c4f-0414-4002-adfd-b2fd10b1cd53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-791717922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7713a76bb546d2a348927f18b12eb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70a5cfd-b9", "ovs_interfaceid": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Converting VIF {"id": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "address": "fa:16:3e:79:68:d8", "network": {"id": "0ef60c4f-0414-4002-adfd-b2fd10b1cd53", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-791717922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a7713a76bb546d2a348927f18b12eb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf70a5cfd-b9", "ovs_interfaceid": "f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:68:d8,bridge_name='br-int',has_traffic_filtering=True,id=f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1,network=Network(0ef60c4f-0414-4002-adfd-b2fd10b1cd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70a5cfd-b9') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_vif [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:68:d8,bridge_name='br-int',has_traffic_filtering=True,id=f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1,network=Network(0ef60c4f-0414-4002-adfd-b2fd10b1cd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70a5cfd-b9') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf70a5cfd-b9, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:51:58 user nova-compute[82184]: INFO os_vif [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:68:d8,bridge_name='br-int',has_traffic_filtering=True,id=f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1,network=Network(0ef60c4f-0414-4002-adfd-b2fd10b1cd53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf70a5cfd-b9')
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mSZCYyKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:51:58 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f26efe9-51eb-4fe4-a683-7f86b95e22e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:51:58 user nova-compute[82184]: No targets found.
Apr 12 01:51:58 user nova-compute[82184]: iSNS:
Apr 12 01:51:58 user nova-compute[82184]: No targets found.
Apr 12 01:51:58 user nova-compute[82184]: STATIC:
Apr 12 01:51:58 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:51:58 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:51:58 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:51:58 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb
Apr 12 01:51:58 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:51:58 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:51:58 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857
Apr 12 01:51:58 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:51:58 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:51:58 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:51:58 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:51:58 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:51:58 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86
Apr 12 01:51:58 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:51:58 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:51:58 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:51:58 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:51:58 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:51:58 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d
Apr 12 01:51:58 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:51:58 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:51:58 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8
Apr 12 01:51:58 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:51:58 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:51:58 user nova-compute[82184]: FIRMWARE:
Apr 12 01:51:58 user nova-compute[82184]: No targets found.
Apr 12 01:51:58 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:51:58 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:51:58 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[324b4991-633d-4e6c-ad8a-6a642d08b447]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd251ddc-2ce4-42e2-ae40-4654d477a515]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:51:58 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 (non-flash)
Apr 12 01:51:58 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:51:58 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b7318700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857'): ({'sdh'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Removing single pathed devices sdh {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cd4adc-a382-4e3d-a67f-3969640461ff]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a9409a-f956-4720-9c46-1c9853b58bb6]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Flushing IO for device /dev/sdh {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f6865-a08b-4f60-b3a4-abb7e53ad958]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b1e84c-56e5-4269-bdcf-4321f3c537b0]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] SCSI volumes sdh have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21b2dc0-a5c6-4ceb-a9a1-1cf368898cda]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66df6f47-7f16-4273-9cf0-b2a14fd49aa7]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857, portal: 172.16.0.220,3260]
Apr 12 01:51:58 user nova-compute[82184]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857, portal: 172.16.0.220,3260] successful.
Apr 12 01:51:58 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fb6599-c30a-4a61-ab9b-ae62affb4857 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ead94-ab61-4aec-ae75-e70304a84350]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] <== disconnect_volume: return (381ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:51:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:51:58 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Deleting instance files /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c_del
Apr 12 01:51:58 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Deletion of /opt/stack/data/nova/instances/371f55da-306a-4ef9-b04f-7c22e8071e5c_del complete
Apr 12 01:51:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Checking UEFI support for host arch (x86_64) {{(pid=82184) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 12 01:51:59 user nova-compute[82184]: INFO nova.virt.libvirt.host [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] UEFI support detected
Apr 12 01:51:59 user nova-compute[82184]: INFO nova.compute.manager [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Took 1.36 seconds to destroy the instance on the hypervisor.
Apr 12 01:51:59 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:51:59 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:51:59 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:51:59 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance destroyed successfully.
Apr 12 01:51:59 user nova-compute[82184]: DEBUG nova.compute.manager [None req-39d8cb83-0db3-4a02-a9ac-4da96c12cdd2 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:51:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-39d8cb83-0db3-4a02-a9ac-4da96c12cdd2 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.024s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:00 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Took 1.00 seconds to deallocate network for instance.
Apr 12 01:52:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-e297c1f7-1423-4b5e-942f-229e5436706c req-cd7c2fc2-903e-4466-b527-15ac477a6f6f service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Received event network-vif-deleted-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:00 user nova-compute[82184]: INFO nova.compute.manager [req-e297c1f7-1423-4b5e-942f-229e5436706c req-cd7c2fc2-903e-4466-b527-15ac477a6f6f service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Neutron deleted interface f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1; detaching it from the instance and deleting it from the info cache
Apr 12 01:52:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-e297c1f7-1423-4b5e-942f-229e5436706c req-cd7c2fc2-903e-4466-b527-15ac477a6f6f service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-e297c1f7-1423-4b5e-942f-229e5436706c req-cd7c2fc2-903e-4466-b527-15ac477a6f6f service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Detach interface failed, port_id=f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1, reason: Instance 371f55da-306a-4ef9-b04f-7c22e8071e5c could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Received event network-vif-plugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] Acquiring lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] No waiting events found dispatching network-vif-plugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:00 user nova-compute[82184]: WARNING nova.compute.manager [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Received unexpected event network-vif-plugged-f70a5cfd-b9e1-4585-bb0c-5c8f0f3bb1f1 for instance with vm_state active and task_state deleting.
Apr 12 01:52:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-unplugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-unplugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:00 user nova-compute[82184]: WARNING nova.compute.manager [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-unplugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state stopped and task_state None.
Apr 12 01:52:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:00 user nova-compute[82184]: WARNING nova.compute.manager [req-a0451880-0039-46b1-b5af-e9f0abdb0718 req-93b65782-f143-46ad-8155-8245bacae58e service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state stopped and task_state None.
Apr 12 01:52:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:00 user nova-compute[82184]: INFO nova.compute.manager [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Took 0.87 seconds to detach 1 volumes for instance.
Apr 12 01:52:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:01 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:52:01 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:52:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:01 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Deleted allocations for instance 371f55da-306a-4ef9-b04f-7c22e8071e5c
Apr 12 01:52:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-566d5dcd-1a35-45f5-b562-a9e4f15624d9 tempest-DeleteServersTestJSON-986135774 tempest-DeleteServersTestJSON-986135774-project-member] Lock "371f55da-306a-4ef9-b04f-7c22e8071e5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.861s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-f4898349-6c1c-4c00-9cdc-61223681d895 req-e56407e8-a764-43f6-8eba-cb70d9abaf53 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received event network-changed-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-f4898349-6c1c-4c00-9cdc-61223681d895 req-e56407e8-a764-43f6-8eba-cb70d9abaf53 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Refreshing instance network info cache due to event network-changed-38b808a5-094e-480a-b52f-d36407148227. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:52:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f4898349-6c1c-4c00-9cdc-61223681d895 req-e56407e8-a764-43f6-8eba-cb70d9abaf53 service nova] Acquiring lock "refresh_cache-f2eedf78-0fd6-4cc1-8efd-50958e07fde6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:52:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f4898349-6c1c-4c00-9cdc-61223681d895 req-e56407e8-a764-43f6-8eba-cb70d9abaf53 service nova] Acquired lock "refresh_cache-f2eedf78-0fd6-4cc1-8efd-50958e07fde6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:52:05 user nova-compute[82184]: DEBUG nova.network.neutron [req-f4898349-6c1c-4c00-9cdc-61223681d895 req-e56407e8-a764-43f6-8eba-cb70d9abaf53 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Refreshing network info cache for port 38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:52:06 user nova-compute[82184]: DEBUG nova.network.neutron [req-f4898349-6c1c-4c00-9cdc-61223681d895 req-e56407e8-a764-43f6-8eba-cb70d9abaf53 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Updated VIF entry in instance network info cache for port 38b808a5-094e-480a-b52f-d36407148227. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:52:06 user nova-compute[82184]: DEBUG nova.network.neutron [req-f4898349-6c1c-4c00-9cdc-61223681d895 req-e56407e8-a764-43f6-8eba-cb70d9abaf53 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Updating instance_info_cache with network_info: [{"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f4898349-6c1c-4c00-9cdc-61223681d895 req-e56407e8-a764-43f6-8eba-cb70d9abaf53 service nova] Releasing lock "refresh_cache-f2eedf78-0fd6-4cc1-8efd-50958e07fde6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG nova.objects.instance [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lazy-loading 'flavor' on Instance uuid f2eedf78-0fd6-4cc1-8efd-50958e07fde6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:07 user nova-compute[82184]: INFO nova.compute.manager [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Attaching volume 616face5-aa52-40cc-98f1-87cecb1e9bef to /dev/sdc
Apr 12 01:52:07 user nova-compute[82184]: DEBUG os_brick.utils [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a456ce5-a989-44e9-8c04-39e023e43b36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[733c0950-1b60-41d6-90ab-55cf5f1e7fae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b78810-59fe-41d5-b1e4-22d2a20ea1ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4cf73e-0341-4d72-bb97-5a0a50559273]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:52:07 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:52:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b78cd23-4848-4148-9cbe-823a49f0131f]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG os_brick.utils [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:07 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Updating existing volume attachment record: 3e63a8c8-6436-4960-b354-5833ce92d161 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:52:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-c6fe0d8a-275a-458d-be52-2dfc76db767a req-c89000f1-ad96-41c4-8110-63192cc3ccd1 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received event network-changed-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-c6fe0d8a-275a-458d-be52-2dfc76db767a req-c89000f1-ad96-41c4-8110-63192cc3ccd1 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Refreshing instance network info cache due to event network-changed-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:52:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6fe0d8a-275a-458d-be52-2dfc76db767a req-c89000f1-ad96-41c4-8110-63192cc3ccd1 service nova] Acquiring lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:52:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6fe0d8a-275a-458d-be52-2dfc76db767a req-c89000f1-ad96-41c4-8110-63192cc3ccd1 service nova] Acquired lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:52:10 user nova-compute[82184]: DEBUG nova.network.neutron [req-c6fe0d8a-275a-458d-be52-2dfc76db767a req-c89000f1-ad96-41c4-8110-63192cc3ccd1 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Refreshing network info cache for port f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:52:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-c6fe0d8a-275a-458d-be52-2dfc76db767a req-c89000f1-ad96-41c4-8110-63192cc3ccd1 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Updated VIF entry in instance network info cache for port f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-c6fe0d8a-275a-458d-be52-2dfc76db767a req-c89000f1-ad96-41c4-8110-63192cc3ccd1 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Updating instance_info_cache with network_info: [{"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6fe0d8a-275a-458d-be52-2dfc76db767a req-c89000f1-ad96-41c4-8110-63192cc3ccd1 service nova] Releasing lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tRxBuaTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:11 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:11 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:11 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f11e7ff-8b6f-4681-9ba4-2a4b865b12c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:52:11 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[62490840-4d94-418e-a492-d8bfb1b5eae1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef] added
Apr 12 01:52:11 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4482952-7063-4423-b4cd-f9f0dbd77aa3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e92ecf-5259-4087-99a8-19ca9076de26]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tRxBuaTs {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tRxBuaTs" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ab46ae-9d85-40ec-88a8-098c8fb2e532]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tRxBuaTs'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09f886c-8d48-45ec-9929-973adebd8729]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b5b677-9fef-4907-8ef1-3df505b366b5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG nova.objects.instance [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lazy-loading 'flavor' on Instance uuid 2dbe5433-e1e5-4b85-a0f7-904c3b784335 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a479f3d0-cdd0-46ce-82f1-e7eb2c4e87d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef, portal: 172.16.0.220,3260]
Apr 12 01:52:12 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0549ccb2-389c-44c5-96ce-a837f97070cc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af1b5b5-4ada-4f1e-b529-03ad612e9495]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:12 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe36bd5-dc3d-480d-8091-f8bb26596f79]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tRxBuaTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:12 user nova-compute[82184]: INFO nova.compute.manager [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Attaching volume d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a to /dev/vdb
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.utils [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcae54d-e19e-4bee-8fa2-dddd741d8af9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b963eb2-2070-478d-afc6-cae489279e16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a056258-044b-42c8-a171-50afaf905388]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f922df3f-2afc-42a2-9528-6b6cc7f33cba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:52:12 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9542e3bd-b81c-42e5-b2a7-ce9c10e249e4]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.utils [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Updating existing volume attachment record: e4080a17-8245-4a6f-bbc4-af1d09c9b763 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1f26554-1bda-404e-8d9d-4c26ef07e2fe req-67957465-9ab7-4c4e-afd6-0c453ac288aa service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received event network-changed-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1f26554-1bda-404e-8d9d-4c26ef07e2fe req-67957465-9ab7-4c4e-afd6-0c453ac288aa service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Refreshing instance network info cache due to event network-changed-0afbc2d8-20bd-4f40-b45b-53bad28276d4. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1f26554-1bda-404e-8d9d-4c26ef07e2fe req-67957465-9ab7-4c4e-afd6-0c453ac288aa service nova] Acquiring lock "refresh_cache-34cbdbd9-16ac-4cbc-be28-c88b7c23de02" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1f26554-1bda-404e-8d9d-4c26ef07e2fe req-67957465-9ab7-4c4e-afd6-0c453ac288aa service nova] Acquired lock "refresh_cache-34cbdbd9-16ac-4cbc-be28-c88b7c23de02" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG nova.network.neutron [req-a1f26554-1bda-404e-8d9d-4c26ef07e2fe req-67957465-9ab7-4c4e-afd6-0c453ac288aa service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Refreshing network info cache for port 0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG nova.objects.instance [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lazy-loading 'flavor' on Instance uuid 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:12 user nova-compute[82184]: INFO nova.compute.manager [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Attaching volume 30e993bc-91f0-45c4-b5fa-5781522df5fb to /dev/vdb
Apr 12 01:52:12 user nova-compute[82184]: DEBUG os_brick.utils [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[996919cf-42a6-4570-b5ec-df4aab39717f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[936070bf-e9c2-4a7b-ad15-b4f0ddbc738b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa70d6db-3e59-4e91-a3c6-14582ca6e8da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[71182560-7f34-4e4e-a177-67e5afb76c84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:52:13 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9025e0ef-90db-4b36-86f0-d526937444e2]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG os_brick.utils [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Updating existing volume attachment record: 200a84d5-ab25-40c5-9f5d-e863d44a3a8e {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.network.neutron [req-a1f26554-1bda-404e-8d9d-4c26ef07e2fe req-67957465-9ab7-4c4e-afd6-0c453ac288aa service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Updated VIF entry in instance network info cache for port 0afbc2d8-20bd-4f40-b45b-53bad28276d4. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.network.neutron [req-a1f26554-1bda-404e-8d9d-4c26ef07e2fe req-67957465-9ab7-4c4e-afd6-0c453ac288aa service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Updating instance_info_cache with network_info: [{"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1f26554-1bda-404e-8d9d-4c26ef07e2fe req-67957465-9ab7-4c4e-afd6-0c453ac288aa service nova] Releasing lock "refresh_cache-34cbdbd9-16ac-4cbc-be28-c88b7c23de02" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '26433633164313238', 'path': '/dev/sdh'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433633164313238', 'path': '/dev/sdh'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.objects.instance [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lazy-loading 'flavor' on Instance uuid f2eedf78-0fd6-4cc1-8efd-50958e07fde6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:52:13 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:52:13 user nova-compute[82184]:   <source dev="/dev/sdh"/>
Apr 12 01:52:13 user nova-compute[82184]:   <target dev="sdc" bus="scsi"/>
Apr 12 01:52:13 user nova-compute[82184]:   <serial>616face5-aa52-40cc-98f1-87cecb1e9bef</serial>
Apr 12 01:52:13 user nova-compute[82184]:   <address type="drive" controller="0" unit="2"/>
Apr 12 01:52:13 user nova-compute[82184]: </disk>
Apr 12 01:52:13 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264318.5198894, 371f55da-306a-4ef9-b04f-7c22e8071e5c => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:52:13 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] VM Stopped (Lifecycle Event)
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bbc99e07-d45c-40a9-88cb-3b8141a5b30b None None] [instance: 371f55da-306a-4ef9-b04f-7c22e8071e5c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] No BDM found with device name sda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] No BDM found with device name sdc, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] No VIF found with MAC fa:16:3e:5e:35:b7, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:52:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ae649a75-9990-4f10-9080-fe8e5d9e2250 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.402s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:14 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264319.0724247, cb89325c-680a-4413-8e94-4eddfaa79c6b => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:52:14 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] VM Stopped (Lifecycle Event)
Apr 12 01:52:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-24c5e4ca-8d54-4967-956c-fd5162ac0655 None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:52:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-24c5e4ca-8d54-4967-956c-fd5162ac0655 None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:52:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:14 user nova-compute[82184]: INFO nova.compute.manager [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Detaching volume 616face5-aa52-40cc-98f1-87cecb1e9bef
Apr 12 01:52:14 user nova-compute[82184]: INFO nova.virt.block_device [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Attempting to driver detach volume 616face5-aa52-40cc-98f1-87cecb1e9bef from mountpoint /dev/sdc
Apr 12 01:52:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Attempting to detach device sdc from instance f2eedf78-0fd6-4cc1-8efd-50958e07fde6 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:52:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:52:14 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:52:14 user nova-compute[82184]:   <source dev="/dev/sdh"/>
Apr 12 01:52:14 user nova-compute[82184]:   <target dev="sdc" bus="scsi"/>
Apr 12 01:52:14 user nova-compute[82184]:   <serial>616face5-aa52-40cc-98f1-87cecb1e9bef</serial>
Apr 12 01:52:14 user nova-compute[82184]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 01:52:14 user nova-compute[82184]: </disk>
Apr 12 01:52:14 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:52:14 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Successfully detached device sdc from instance f2eedf78-0fd6-4cc1-8efd-50958e07fde6 from the persistent domain config.
Apr 12 01:52:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f2eedf78-0fd6-4cc1-8efd-50958e07fde6 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:52:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:52:14 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:52:14 user nova-compute[82184]:   <source dev="/dev/sdh"/>
Apr 12 01:52:14 user nova-compute[82184]:   <target dev="sdc" bus="scsi"/>
Apr 12 01:52:14 user nova-compute[82184]:   <serial>616face5-aa52-40cc-98f1-87cecb1e9bef</serial>
Apr 12 01:52:14 user nova-compute[82184]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 01:52:14 user nova-compute[82184]: </disk>
Apr 12 01:52:14 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264335.0162232, f2eedf78-0fd6-4cc1-8efd-50958e07fde6 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f2eedf78-0fd6-4cc1-8efd-50958e07fde6 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:52:15 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Successfully detached device sdc from instance f2eedf78-0fd6-4cc1-8efd-50958e07fde6 from the live domain config.
Apr 12 01:52:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tRxBuaTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:15 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e734d12d-7933-427c-b20f-f51bc1cee109]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:15 user nova-compute[82184]: No targets found.
Apr 12 01:52:15 user nova-compute[82184]: iSNS:
Apr 12 01:52:15 user nova-compute[82184]: No targets found.
Apr 12 01:52:15 user nova-compute[82184]: STATIC:
Apr 12 01:52:15 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:15 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:15 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:15 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef
Apr 12 01:52:15 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:15 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:15 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb
Apr 12 01:52:15 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:15 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:15 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:52:15 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:15 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:15 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86
Apr 12 01:52:15 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:15 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:15 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:15 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:15 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:15 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d
Apr 12 01:52:15 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:15 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:15 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8
Apr 12 01:52:15 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:15 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:15 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:15 user nova-compute[82184]: No targets found.
Apr 12 01:52:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:15 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:15 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[323c8b8f-167b-42cd-b223-cae7eba76d67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1becd0-6030-4ca9-856a-7b040e04f761]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:15 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a81e3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef'): ({'sdh'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Removing single pathed devices sdh {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e4841d-eeaf-4073-bc2d-0c683c6307bd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28d9083-ebc1-45bb-a63d-289f0dc3c0b9]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Flushing IO for device /dev/sdh {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[091f00fa-3224-4db3-ba71-88a15dda1677]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1049c367-bad2-42e6-9227-cb33a1be8260]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] SCSI volumes sdh have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fef859-4b5f-4405-8928-a2ced881f9b4]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ffdd20-77d8-46cc-bae4-255dd550e7fa]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef, portal: 172.16.0.220,3260]
Apr 12 01:52:15 user nova-compute[82184]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:616face5-aa52-40cc-98f1-87cecb1e9bef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32791115-d543-4332-a0c1-185827c23db1]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] <== disconnect_volume: return (345ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG nova.objects.instance [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lazy-loading 'flavor' on Instance uuid f2eedf78-0fd6-4cc1-8efd-50958e07fde6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-45c0674a-5bed-463d-aa4d-76cd607afba3 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.687s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:16 user nova-compute[82184]: INFO nova.compute.manager [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Terminating instance
Apr 12 01:52:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-82d5de8d-43fc-4eab-9d21-98efb9767b80 req-d0e49049-d33c-4e14-8f54-f9988a53c505 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received event network-vif-unplugged-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-82d5de8d-43fc-4eab-9d21-98efb9767b80 req-d0e49049-d33c-4e14-8f54-f9988a53c505 service nova] Acquiring lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-82d5de8d-43fc-4eab-9d21-98efb9767b80 req-d0e49049-d33c-4e14-8f54-f9988a53c505 service nova] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-82d5de8d-43fc-4eab-9d21-98efb9767b80 req-d0e49049-d33c-4e14-8f54-f9988a53c505 service nova] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-82d5de8d-43fc-4eab-9d21-98efb9767b80 req-d0e49049-d33c-4e14-8f54-f9988a53c505 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] No waiting events found dispatching network-vif-unplugged-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-82d5de8d-43fc-4eab-9d21-98efb9767b80 req-d0e49049-d33c-4e14-8f54-f9988a53c505 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received event network-vif-unplugged-38b808a5-094e-480a-b52f-d36407148227 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUTOZodH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:16 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:16 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:16 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c66c4fc-297a-46af-af68-c89390a83229]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:52:16 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c35122-9822-43ca-ae13-f600f6839140]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a] added
Apr 12 01:52:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[45be7bbb-8f23-4fc7-a7dc-da191356ade9]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d10ec59-a015-43f3-adab-7c94dc525c67]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUTOZodH {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iUTOZodH" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fb57ab-6af7-4287-81e1-8023a5d647a0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iUTOZodH'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ced7b7b-da6a-49de-92a3-d843b1a98498]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b91834-8f08-4f75-bb48-0545f75203fd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:17 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:17 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bea386-08f4-4b57-87d0-0446fff14587]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a, portal: 172.16.0.220,3260]
Apr 12 01:52:17 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:17 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[623747bf-355a-442a-9b32-75158d84298d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaf63fb-8cc5-4c43-88c8-de15ac8c40e8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:17 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:17 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:17 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2ae70f-2f40-4d6d-a443-b2982c6995f3]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUTOZodH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:52:17 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Instance destroyed successfully.
Apr 12 01:52:17 user nova-compute[82184]: DEBUG nova.objects.instance [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lazy-loading 'resources' on Instance uuid f2eedf78-0fd6-4cc1-8efd-50958e07fde6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1735119552',display_name='tempest-AttachSCSIVolumeTestJSON-server-1735119552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1735119552',id=7,image_ref='aaf0837b-b109-4309-87a6-5a6729f0eccc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoBx7IwA26nr+H9WbInCKQvzt885MvXO4T7OFAxKtTB1Y+/K8rC2POLNWs9WxsvQqtRVrXppKseGE6lFkO0s+3jTpEjBu+bRewGqCxddqqCMhq2Zh6JTma7wnriFenAJw==',key_name='tempest-keypair-38328491',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='742d0477bb3b464e8d98d42a85c330e7',ramdisk_id='',reservation_id='r-9oa0e0ek',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='aaf0837b-b109-4309-87a6-5a6729f0eccc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1163480770',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1163480770-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e400a3359c844c449445cfba08ef7a7b',uuid=f2eedf78-0fd6-4cc1-8efd-50958e07fde6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Converting VIF {"id": "38b808a5-094e-480a-b52f-d36407148227", "address": "fa:16:3e:5e:35:b7", "network": {"id": "e5e461dd-9a8b-4f2a-90ec-34fb659152b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1047467879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "742d0477bb3b464e8d98d42a85c330e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b808a5-09", "ovs_interfaceid": "38b808a5-094e-480a-b52f-d36407148227", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:35:b7,bridge_name='br-int',has_traffic_filtering=True,id=38b808a5-094e-480a-b52f-d36407148227,network=Network(e5e461dd-9a8b-4f2a-90ec-34fb659152b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b808a5-09') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_vif [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:35:b7,bridge_name='br-int',has_traffic_filtering=True,id=38b808a5-094e-480a-b52f-d36407148227,network=Network(e5e461dd-9a8b-4f2a-90ec-34fb659152b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b808a5-09') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38b808a5-09, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:17 user nova-compute[82184]: INFO os_vif [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:35:b7,bridge_name='br-int',has_traffic_filtering=True,id=38b808a5-094e-480a-b52f-d36407148227,network=Network(e5e461dd-9a8b-4f2a-90ec-34fb659152b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b808a5-09')
Apr 12 01:52:17 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Deleting instance files /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6_del
Apr 12 01:52:17 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Deletion of /opt/stack/data/nova/instances/f2eedf78-0fd6-4cc1-8efd-50958e07fde6_del complete
Apr 12 01:52:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkyBCHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:17 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:17 user nova-compute[82184]: INFO nova.compute.manager [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 01:52:17 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:52:17 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:18 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Took 0.73 seconds to deallocate network for instance.
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26330633762333332', 'path': '/dev/sdh'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330633762333332', 'path': '/dev/sdh'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.817s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:18 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:18 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.objects.instance [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lazy-loading 'flavor' on Instance uuid 2dbe5433-e1e5-4b85-a0f7-904c3b784335 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20307185-cb3e-4c05-bdcb-c14950686265]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:52:18 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:52:18 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:52:18 user nova-compute[82184]:   <source dev="/dev/sdh"/>
Apr 12 01:52:18 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:52:18 user nova-compute[82184]:   <serial>d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a</serial>
Apr 12 01:52:18 user nova-compute[82184]: </disk>
Apr 12 01:52:18 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[342d40bc-017e-42a0-b883-d9d23ee9d577]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb] added
Apr 12 01:52:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f8622-b124-44b3-89b7-abcf1ac92b37]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b392ffd-76df-4e33-ac6b-8734761409b3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkyBCHiv {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkyBCHiv" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[735a9c6b-86d8-48bf-a030-2a88bcfc16be]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkyBCHiv'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[155fc00a-5385-4a87-835d-ae61dac7020f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa196e4d-0277-48b6-95ac-17aacaeaf81c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfe17a0-5a89-4318-a543-276da471a783]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260]
Apr 12 01:52:18 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[597bf47e-9d7a-4593-8763-beb499e692dc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Deleted allocations for instance f2eedf78-0fd6-4cc1-8efd-50958e07fde6
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c75004a-83cb-4dbb-82b2-78775cdbad5b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:18 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[939494a6-3110-4fc4-ac1b-c963c1b9500f]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkyBCHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] No VIF found with MAC fa:16:3e:fd:23:a5, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bcba319d-011e-461a-8cb4-2a10fad8d418 tempest-AttachSCSIVolumeTestJSON-1163480770 tempest-AttachSCSIVolumeTestJSON-1163480770-project-member] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.155s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d6ab4b69-8603-4354-b1d4-9fd31c07913a tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.474s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-f0edfeee-e89e-4103-ae6b-91e56bc7f55c req-0afc50c9-e25d-479c-9852-0aef984f9c85 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received event network-vif-plugged-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f0edfeee-e89e-4103-ae6b-91e56bc7f55c req-0afc50c9-e25d-479c-9852-0aef984f9c85 service nova] Acquiring lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f0edfeee-e89e-4103-ae6b-91e56bc7f55c req-0afc50c9-e25d-479c-9852-0aef984f9c85 service nova] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f0edfeee-e89e-4103-ae6b-91e56bc7f55c req-0afc50c9-e25d-479c-9852-0aef984f9c85 service nova] Lock "f2eedf78-0fd6-4cc1-8efd-50958e07fde6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-f0edfeee-e89e-4103-ae6b-91e56bc7f55c req-0afc50c9-e25d-479c-9852-0aef984f9c85 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] No waiting events found dispatching network-vif-plugged-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:18 user nova-compute[82184]: WARNING nova.compute.manager [req-f0edfeee-e89e-4103-ae6b-91e56bc7f55c req-0afc50c9-e25d-479c-9852-0aef984f9c85 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received unexpected event network-vif-plugged-38b808a5-094e-480a-b52f-d36407148227 for instance with vm_state deleted and task_state None.
Apr 12 01:52:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-f0edfeee-e89e-4103-ae6b-91e56bc7f55c req-0afc50c9-e25d-479c-9852-0aef984f9c85 service nova] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Received event network-vif-deleted-38b808a5-094e-480a-b52f-d36407148227 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] <== connect_volume: return (2230ms) {'type': 'block', 'scsi_wwn': '23464353063343866', 'path': '/dev/sdj'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464353063343866', 'path': '/dev/sdj'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:52:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lazy-loading 'flavor' on Instance uuid 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:52:19 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:52:19 user nova-compute[82184]:   <source dev="/dev/sdj"/>
Apr 12 01:52:19 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:52:19 user nova-compute[82184]:   <serial>30e993bc-91f0-45c4-b5fa-5781522df5fb</serial>
Apr 12 01:52:19 user nova-compute[82184]: </disk>
Apr 12 01:52:19 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:20 user nova-compute[82184]: INFO nova.compute.manager [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Detaching volume d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a
Apr 12 01:52:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] No VIF found with MAC fa:16:3e:ea:a4:9a, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:52:20 user nova-compute[82184]: INFO nova.virt.block_device [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Attempting to driver detach volume d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a from mountpoint /dev/vdb
Apr 12 01:52:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Attempting to detach device vdb from instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:52:20 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:52:20 user nova-compute[82184]:   <source dev="/dev/sdh"/>
Apr 12 01:52:20 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:52:20 user nova-compute[82184]:   <serial>d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a</serial>
Apr 12 01:52:20 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:52:20 user nova-compute[82184]: </disk>
Apr 12 01:52:20 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:52:20 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Successfully detached device vdb from instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 from the persistent domain config.
Apr 12 01:52:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:52:20 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:52:20 user nova-compute[82184]:   <source dev="/dev/sdh"/>
Apr 12 01:52:20 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:52:20 user nova-compute[82184]:   <serial>d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a</serial>
Apr 12 01:52:20 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:52:20 user nova-compute[82184]: </disk>
Apr 12 01:52:20 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-56081dfc-ea07-4189-8a7e-2922d194cb58 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.367s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264340.6583834, 2dbe5433-e1e5-4b85-a0f7-904c3b784335 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:52:20 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Successfully detached device vdb from instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 from the live domain config.
Apr 12 01:52:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUTOZodH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:20 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf9b3b5-9387-45ce-8468-873f07463651]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:20 user nova-compute[82184]: No targets found.
Apr 12 01:52:20 user nova-compute[82184]: iSNS:
Apr 12 01:52:20 user nova-compute[82184]: No targets found.
Apr 12 01:52:20 user nova-compute[82184]: STATIC:
Apr 12 01:52:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a
Apr 12 01:52:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb
Apr 12 01:52:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb
Apr 12 01:52:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:52:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86
Apr 12 01:52:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d
Apr 12 01:52:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8
Apr 12 01:52:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:20 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:20 user nova-compute[82184]: No targets found.
Apr 12 01:52:20 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:20 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:20 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14ce229-e88a-4a95-890d-554c743cd5f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6761e7eb-5ec2-42d4-840b-41fa9e8ca24a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:20 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:20 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:20 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b4d50dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a'): ({'sdh'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Removing single pathed devices sdh {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba39bc1d-6f24-40e9-9b6c-3a327e3ccb54]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[660096a8-a65d-493f-9bf4-00d89ca2b89d]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Flushing IO for device /dev/sdh {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfa7bdc-7468-4c27-b40f-71ba59c90514]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[578480c7-c353-47c4-9ab6-381a19492509]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] SCSI volumes sdh have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[238838c3-3e85-4688-9945-cf02f876c7e5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --logout" returned: 0 in 0.153s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94fba78-bd59-4c0b-8dc3-61bcdde48e75]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a, portal: 172.16.0.220,3260]
Apr 12 01:52:21 user nova-compute[82184]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:21 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5ebfb2e-aa8c-4745-b23a-09c29a6dc37a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0984a92c-5a03-4693-bd85-128cae8123c3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] <== disconnect_volume: return (445ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG os_brick.utils [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf13d8a5-875f-426a-a0d6-b9d7d51fecc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d542c1-917a-4673-86b7-54a7e61f52b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[407ebb17-50a4-4adc-b6ea-8deddcd3cad0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[504d3d0c-f528-4c26-8b49-68d09ce579b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:52:21 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1801023-01a3-463e-9a0a-bf6402c7ca07]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG os_brick.utils [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:21 user nova-compute[82184]: INFO nova.compute.manager [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Swapping volume 30e993bc-91f0-45c4-b5fa-5781522df5fb for d08e265d-55d4-4542-a7fe-359cd0740624
Apr 12 01:52:21 user nova-compute[82184]: DEBUG nova.objects.instance [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lazy-loading 'flavor' on Instance uuid 2dbe5433-e1e5-4b85-a0f7-904c3b784335 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-87686348-ee65-4e81-90b8-5b25a8b3e7d4 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.867s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFQDljUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34cbdbd9-16ac-4cbc-be28-c88b7c23de02', 'attached_at': '', 'detached_at': '', 'volume_id': 'd08e265d-55d4-4542-a7fe-359cd0740624', 'serial': 'd08e265d-55d4-4542-a7fe-359cd0740624'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkyBCHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '34cbdbd9-16ac-4cbc-be28-c88b7c23de02', 'attached_at': '', 'detached_at': '', 'volume_id': '30e993bc-91f0-45c4-b5fa-5781522df5fb', 'serial'} {{(pid=82184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFQDljUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:25 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:25 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:25 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f890c5-3119-4fbb-81b9-144591d4d1c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:52:25 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c711c3b6-a0d5-4114-8461-4cb5f2dc3ea3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624] added
Apr 12 01:52:25 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[526f20a0-5d35-4289-8f6d-745001c6c28a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3e50bf-04b5-4bf2-abb0-2f0e5bd0c1bf]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFQDljUK {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFQDljUK" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e9415f-aa2f-4a6f-a908-f696ac7bc96d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EFQDljUK'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[914de8cd-6a58-4e14-b4a8-8b7a213557f1]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54241d0b-bbd5-4de4-9fd2-8ed980019d5d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:25 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:25 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:25 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:25 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e30dc1-5052-4dff-9829-b742529c83b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624, portal: 172.16.0.220,3260]
Apr 12 01:52:26 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[de043332-323d-4d11-bf26-e5dcc058f5c1]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bde0ab2-f917-416b-b605-d817bd35de0e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:26 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5564e1f5-66fb-4efd-98c3-1bcc087f24e7]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:52:27 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:52:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFQDljUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:52:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23764303930653439', 'path': '/dev/sdh'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764303930653439', 'path': '/dev/sdh'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:52:27 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lazy-loading 'flavor' on Instance uuid 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 134217728 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 286261248 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 456130560 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 652214272 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 846200832 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 1026555904 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkyBCHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:31 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0abb42-5c95-42b3-b988-e407145e40d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:31 user nova-compute[82184]: No targets found.
Apr 12 01:52:31 user nova-compute[82184]: iSNS:
Apr 12 01:52:31 user nova-compute[82184]: No targets found.
Apr 12 01:52:31 user nova-compute[82184]: STATIC:
Apr 12 01:52:31 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb
Apr 12 01:52:31 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:31 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:31 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:31 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:31 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:31 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb
Apr 12 01:52:31 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:31 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:31 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:52:31 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:31 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:31 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86
Apr 12 01:52:31 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:31 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:31 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:31 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:31 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:31 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d
Apr 12 01:52:31 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:31 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:31 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624
Apr 12 01:52:31 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:31 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:31 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8
Apr 12 01:52:31 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:31 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:31 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:31 user nova-compute[82184]: No targets found.
Apr 12 01:52:31 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:31 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:31 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e772dbb8-a38a-4dad-b6a5-ca22d3d280ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf92ff56-2730-4106-9775-3591f7a72993]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:31 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:31 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:31 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a85ce680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb'): ({'sdj'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Removing single pathed devices sdj {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c182edbe-cc71-439b-8eeb-da7006a7fbbd]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e1f4a4-d04f-4e04-8094-fb5a8f5c576f]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Flushing IO for device /dev/sdj {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae44cf81-e164-475a-b88d-f80cfc477e13]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.100s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6af5ec-920f-4570-b8ee-cb9442f73d32]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] SCSI volumes sdj have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bca954-24a2-4841-bccd-695951aa9bbd]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bbe6d3-e42c-497b-b9db-4a9ce69533b4]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260]
Apr 12 01:52:31 user nova-compute[82184]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:31 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c6c5d6-79be-4440-bb3a-0c22a8b1a30a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] <== disconnect_volume: return (412ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFQDljUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '34cbdbd9-16ac-4cbc-be28-c88b7c23de02', 'attached_at': '', 'detached_at': '', 'volume_id': 'd08e265d-55d4-4542-a7fe-359cd0740624', 'serial'} {{(pid=82184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 01:52:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] swap_volume: removing Cinder connection for volume 30e993bc-91f0-45c4-b5fa-5781522df5fb {{(pid=82184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 01:52:32 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264337.4010577, f2eedf78-0fd6-4cc1-8efd-50958e07fde6 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:52:32 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] VM Stopped (Lifecycle Event)
Apr 12 01:52:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0f10d40e-c6a7-4b76-aec9-54a0cdb3d29d None None] [instance: f2eedf78-0fd6-4cc1-8efd-50958e07fde6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:52:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] swap_volume: Updating volume 30e993bc-91f0-45c4-b5fa-5781522df5fb BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "EFQDljUK", "auth_password": "zh5Euj8NmnUWyt", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "d08e265d-55d4-4542-a7fe-359cd0740624"}, "status": "reserved", "instance": "34cbdbd9-16ac-4cbc-be28-c88b7c23de02", "attached_at": "", "detached_at": "", "volume_id": "d08e265d-55d4-4542-a7fe-359cd0740624", "serial": "d08e265d-55d4-4542-a7fe-359cd0740624"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd08e265d-55d4-4542-a7fe-359cd0740624', 'no_device': None, 'attachment_id': 'c6f7c1e1-ca89-4c78-9c89-b6278baf8128'} {{(pid=82184) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 01:52:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a76f9616-5e21-4c1c-bb56-56b06c96ea11 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.378s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG os_brick.utils [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a89330d-d16e-4b1a-8c26-b2070049d721]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8508789-444f-4ba0-bd6f-03a8fe3366dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bef2f4-0354-42c2-be96-aa20c29109e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a676c-2725-4457-8e25-0a0b841b4ad6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:52:33 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:52:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8bb454-d0c2-4cc5-af5a-4e2da7a17a4e]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:52:33 user nova-compute[82184]: DEBUG os_brick.utils [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:33 user nova-compute[82184]: INFO nova.compute.manager [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Swapping volume d08e265d-55d4-4542-a7fe-359cd0740624 for 30e993bc-91f0-45c4-b5fa-5781522df5fb
Apr 12 01:52:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkyBCHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34cbdbd9-16ac-4cbc-be28-c88b7c23de02', 'attached_at': '', 'detached_at': '', 'volume_id': '30e993bc-91f0-45c4-b5fa-5781522df5fb', 'serial': '30e993bc-91f0-45c4-b5fa-5781522df5fb'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFQDljUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'd08e265d-55d4-4542-a7fe-359cd0740624'}, 'status': 'reserved', 'instance': '34cbdbd9-16ac-4cbc-be28-c88b7c23de02', 'attached_at': '', 'detached_at': '', 'volume_id': 'd08e265d-55d4-4542-a7fe-359cd0740624', 'serial'} {{(pid=82184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkyBCHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:37 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:37 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:37 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c30aa1-5386-4a98-ad17-3d16bbf12508]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:52:37 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[483519fc-08f6-4a73-80b2-f3ffe34b0dde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb] added
Apr 12 01:52:37 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[72de4c05-6144-4873-8fc2-e60e8795ec93]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0ff5f1-248f-4640-9d2a-d4991e269519]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkyBCHiv {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkyBCHiv" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b8a756-5709-4cd7-90fa-b030591ed5e8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkyBCHiv'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c1c980-afd0-47f8-aa60-d7397f11bc55]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[176421e9-bdfc-4b8b-9e69-06b961bc1334]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[559477bb-360f-40ef-8384-dfba7af4a659]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260]
Apr 12 01:52:38 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5fe47b-18f2-459c-a93d-d0257753016a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b356a001-82bd-47a6-b402-6f95091df8b9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:38 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b91f2bf-a546-495b-9831-14ef38308050]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:52:39 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:52:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkyBCHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:52:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23464353063343866', 'path': '/dev/sdj'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464353063343866', 'path': '/dev/sdj'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:52:39 user nova-compute[82184]: DEBUG nova.objects.instance [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lazy-loading 'flavor' on Instance uuid 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 10485760 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 170917888 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 352321536 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:52:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:40 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:52:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 536870912 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 725614592 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 907018240 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFQDljUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'd08e265d-55d4-4542-a7fe-359cd0740624': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:42 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dc754c-5a68-4179-9221-2c902bb82182]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:42 user nova-compute[82184]: No targets found.
Apr 12 01:52:42 user nova-compute[82184]: iSNS:
Apr 12 01:52:42 user nova-compute[82184]: No targets found.
Apr 12 01:52:42 user nova-compute[82184]: STATIC:
Apr 12 01:52:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb
Apr 12 01:52:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb
Apr 12 01:52:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:52:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86
Apr 12 01:52:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d
Apr 12 01:52:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624
Apr 12 01:52:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8
Apr 12 01:52:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:42 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:42 user nova-compute[82184]: No targets found.
Apr 12 01:52:42 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:42 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:42 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68b1a0b-e3e5-41b7-9c24-29d6b7110aab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f0a11c-1aa9-46ad-960a-7efa2a48a64f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:43 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:43 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:43 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a8377760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624'): ({'sdh'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Removing single pathed devices sdh {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfcbf45-6f33-40e5-9769-44e35216a0d2]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cb80b2-15b3-4108-b4df-62f10f78f7e2]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Flushing IO for device /dev/sdh {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f3bbf9-508a-4392-af28-60b9bae21dab]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[602ae087-bfc9-44fd-b2ed-b170c9de8961]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] SCSI volumes sdh have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[517f2a9f-2152-4854-82ef-11c005cb5437]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6025ee-2d03-417e-8385-86cd16b81626]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624, portal: 172.16.0.220,3260]
Apr 12 01:52:43 user nova-compute[82184]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:43 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d08e265d-55d4-4542-a7fe-359cd0740624 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99759970-b811-4f22-a669-8df5983d9488]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] <== disconnect_volume: return (425ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkyBCHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '34cbdbd9-16ac-4cbc-be28-c88b7c23de02', 'attached_at': '', 'detached_at': '', 'volume_id': '30e993bc-91f0-45c4-b5fa-5781522df5fb', 'serial'} {{(pid=82184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] swap_volume: removing Cinder connection for volume d08e265d-55d4-4542-a7fe-359cd0740624 {{(pid=82184) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-f3ffb7f0-a37b-491c-9382-51ae496eb949 req-c23d2932-51f5-4a6a-baab-ebef74cfe9d4 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-changed-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-f3ffb7f0-a37b-491c-9382-51ae496eb949 req-c23d2932-51f5-4a6a-baab-ebef74cfe9d4 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing instance network info cache due to event network-changed-de3cdf71-2461-4e2f-b11f-dba0cca9c85f. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f3ffb7f0-a37b-491c-9382-51ae496eb949 req-c23d2932-51f5-4a6a-baab-ebef74cfe9d4 service nova] Acquiring lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f3ffb7f0-a37b-491c-9382-51ae496eb949 req-c23d2932-51f5-4a6a-baab-ebef74cfe9d4 service nova] Acquired lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG nova.network.neutron [req-f3ffb7f0-a37b-491c-9382-51ae496eb949 req-c23d2932-51f5-4a6a-baab-ebef74cfe9d4 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Refreshing network info cache for port de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] swap_volume: Updating volume d08e265d-55d4-4542-a7fe-359cd0740624 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "rkyBCHiv", "auth_password": "sxEcr1gziTFhLS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "30e993bc-91f0-45c4-b5fa-5781522df5fb"}, "status": "reserved", "instance": "34cbdbd9-16ac-4cbc-be28-c88b7c23de02", "attached_at": "", "detached_at": "", "volume_id": "30e993bc-91f0-45c4-b5fa-5781522df5fb", "serial": "30e993bc-91f0-45c4-b5fa-5781522df5fb"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '30e993bc-91f0-45c4-b5fa-5781522df5fb', 'no_device': None, 'attachment_id': '2dd08d77-52de-4d90-a212-fb14765d856c'} {{(pid=82184) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 01:52:44 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:52:44 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=7634MB free_disk=26.57189178466797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-190d0778-f1a6-4127-bd6b-026451758b43 tempest-TestVolumeSwap-1872168700 tempest-TestVolumeSwap-1872168700-project-admin] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 10.989s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cb89325c-680a-4413-8e94-4eddfaa79c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 221e01f2-18c8-468b-993b-480cdda60dd7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 59c7c418-902e-46b7-9302-5c630df18ca2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2f32ace1-1adc-4b75-a1cc-daac2e724846 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:52:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG nova.network.neutron [req-f3ffb7f0-a37b-491c-9382-51ae496eb949 req-c23d2932-51f5-4a6a-baab-ebef74cfe9d4 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updated VIF entry in instance network info cache for port de3cdf71-2461-4e2f-b11f-dba0cca9c85f. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG nova.network.neutron [req-f3ffb7f0-a37b-491c-9382-51ae496eb949 req-c23d2932-51f5-4a6a-baab-ebef74cfe9d4 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [{"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f3ffb7f0-a37b-491c-9382-51ae496eb949 req-c23d2932-51f5-4a6a-baab-ebef74cfe9d4 service nova] Releasing lock "refresh_cache-221e01f2-18c8-468b-993b-480cdda60dd7" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "221e01f2-18c8-468b-993b-480cdda60dd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:45 user nova-compute[82184]: INFO nova.compute.manager [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Detaching volume 30e993bc-91f0-45c4-b5fa-5781522df5fb
Apr 12 01:52:45 user nova-compute[82184]: INFO nova.compute.manager [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Terminating instance
Apr 12 01:52:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:52:45 user nova-compute[82184]: INFO nova.virt.block_device [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Attempting to driver detach volume 30e993bc-91f0-45c4-b5fa-5781522df5fb from mountpoint /dev/vdb
Apr 12 01:52:45 user nova-compute[82184]: DEBUG nova.compute.manager [req-4502ddd0-54a6-49fe-afc0-dd46e12c5d59 req-3bb7844c-ed2c-4b46-b45c-c7cc1b6ff16c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-changed-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG nova.compute.manager [req-4502ddd0-54a6-49fe-afc0-dd46e12c5d59 req-3bb7844c-ed2c-4b46-b45c-c7cc1b6ff16c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing instance network info cache due to event network-changed-6ba40fff-9cc4-47e6-aae2-857a7b1b3445. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4502ddd0-54a6-49fe-afc0-dd46e12c5d59 req-3bb7844c-ed2c-4b46-b45c-c7cc1b6ff16c service nova] Acquiring lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4502ddd0-54a6-49fe-afc0-dd46e12c5d59 req-3bb7844c-ed2c-4b46-b45c-c7cc1b6ff16c service nova] Acquired lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG nova.network.neutron [req-4502ddd0-54a6-49fe-afc0-dd46e12c5d59 req-3bb7844c-ed2c-4b46-b45c-c7cc1b6ff16c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Refreshing network info cache for port 6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Attempting to detach device vdb from instance 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:52:45 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:52:45 user nova-compute[82184]:   <source dev="/dev/sdj"/>
Apr 12 01:52:45 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:52:45 user nova-compute[82184]:   <serial>30e993bc-91f0-45c4-b5fa-5781522df5fb</serial>
Apr 12 01:52:45 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:52:45 user nova-compute[82184]: </disk>
Apr 12 01:52:45 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:52:45 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Successfully detached device vdb from instance 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 from the persistent domain config.
Apr 12 01:52:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:52:45 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:52:45 user nova-compute[82184]:   <source dev="/dev/sdj"/>
Apr 12 01:52:45 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:52:45 user nova-compute[82184]:   <serial>30e993bc-91f0-45c4-b5fa-5781522df5fb</serial>
Apr 12 01:52:45 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:52:45 user nova-compute[82184]: </disk>
Apr 12 01:52:45 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-1e64ad82-334f-40e3-b6a4-9ae03f08b5c1 req-001ddbcf-6554-4e6a-8ed3-be381658909f service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1e64ad82-334f-40e3-b6a4-9ae03f08b5c1 req-001ddbcf-6554-4e6a-8ed3-be381658909f service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1e64ad82-334f-40e3-b6a4-9ae03f08b5c1 req-001ddbcf-6554-4e6a-8ed3-be381658909f service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1e64ad82-334f-40e3-b6a4-9ae03f08b5c1 req-001ddbcf-6554-4e6a-8ed3-be381658909f service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-1e64ad82-334f-40e3-b6a4-9ae03f08b5c1 req-001ddbcf-6554-4e6a-8ed3-be381658909f service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-unplugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-1e64ad82-334f-40e3-b6a4-9ae03f08b5c1 req-001ddbcf-6554-4e6a-8ed3-be381658909f service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264366.3406725, 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:52:46 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Successfully detached device vdb from instance 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 from the live domain config.
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkyBCHiv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '30e993bc-91f0-45c4-b5fa-5781522df5fb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:46 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1b51b6-9e52-400e-9914-98163d126fcd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:46 user nova-compute[82184]: No targets found.
Apr 12 01:52:46 user nova-compute[82184]: iSNS:
Apr 12 01:52:46 user nova-compute[82184]: No targets found.
Apr 12 01:52:46 user nova-compute[82184]: STATIC:
Apr 12 01:52:46 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb
Apr 12 01:52:46 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:46 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:46 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:46 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:46 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:46 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb
Apr 12 01:52:46 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:46 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:46 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:52:46 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:46 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:46 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86
Apr 12 01:52:46 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:46 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:46 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:46 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:46 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:46 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d
Apr 12 01:52:46 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:46 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:46 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8
Apr 12 01:52:46 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:46 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:46 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:46 user nova-compute[82184]: No targets found.
Apr 12 01:52:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:46 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:46 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab018952-8348-4009-9211-5a50ecb2c159]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b181876d-59e0-4ee3-9439-0017103bd370]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:46 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b74b5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb'): ({'sdj'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Removing single pathed devices sdj {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a503e653-ef26-4183-83a0-108395b45b64]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0f6a1e-597c-497c-af09-4b94c574cc56]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Flushing IO for device /dev/sdj {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4381a44-a073-4c53-b6be-bd81b9ffd968]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.049s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f514d6-8d9c-426c-aaad-a5c2c350c4bf]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] SCSI volumes sdj have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b25988-4f9c-4adf-b6ef-d4978b19561f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9592bda2-62e1-4f22-9206-502fa8058f22]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260]
Apr 12 01:52:46 user nova-compute[82184]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-5903ddca-4625-4df5-b6c1-9c86717bf16f req-3f45a993-d462-40d9-ab6a-0c506b289ea4 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5903ddca-4625-4df5-b6c1-9c86717bf16f req-3f45a993-d462-40d9-ab6a-0c506b289ea4 service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5903ddca-4625-4df5-b6c1-9c86717bf16f req-3f45a993-d462-40d9-ab6a-0c506b289ea4 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5903ddca-4625-4df5-b6c1-9c86717bf16f req-3f45a993-d462-40d9-ab6a-0c506b289ea4 service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-5903ddca-4625-4df5-b6c1-9c86717bf16f req-3f45a993-d462-40d9-ab6a-0c506b289ea4 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-unplugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-5903ddca-4625-4df5-b6c1-9c86717bf16f req-3f45a993-d462-40d9-ab6a-0c506b289ea4 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.network.neutron [req-4502ddd0-54a6-49fe-afc0-dd46e12c5d59 req-3bb7844c-ed2c-4b46-b45c-c7cc1b6ff16c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updated VIF entry in instance network info cache for port 6ba40fff-9cc4-47e6-aae2-857a7b1b3445. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.network.neutron [req-4502ddd0-54a6-49fe-afc0-dd46e12c5d59 req-3bb7844c-ed2c-4b46-b45c-c7cc1b6ff16c service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [{"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e993bc-91f0-45c4-b5fa-5781522df5fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[921caa96-6234-4c6f-95e6-2d3127ce1d1c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] <== disconnect_volume: return (385ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4502ddd0-54a6-49fe-afc0-dd46e12c5d59 req-3bb7844c-ed2c-4b46-b45c-c7cc1b6ff16c service nova] Releasing lock "refresh_cache-59c7c418-902e-46b7-9302-5c630df18ca2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:52:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Instance destroyed successfully.
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.objects.instance [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lazy-loading 'resources' on Instance uuid 221e01f2-18c8-468b-993b-480cdda60dd7 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "address": "fa:16:3e:ed:67:29", "network": {"id": "c67ab087-9504-4225-ae6f-3584d8223c4c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1946032478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde3cdf71-24", "ovs_interfaceid": "de3cdf71-2461-4e2f-b11f-dba0cca9c85f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:67:29,bridge_name='br-int',has_traffic_filtering=True,id=de3cdf71-2461-4e2f-b11f-dba0cca9c85f,network=Network(c67ab087-9504-4225-ae6f-3584d8223c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3cdf71-24') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:67:29,bridge_name='br-int',has_traffic_filtering=True,id=de3cdf71-2461-4e2f-b11f-dba0cca9c85f,network=Network(c67ab087-9504-4225-ae6f-3584d8223c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3cdf71-24') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde3cdf71-24, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updating instance_info_cache with network_info: [{"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:52:47 user nova-compute[82184]: INFO os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:67:29,bridge_name='br-int',has_traffic_filtering=True,id=de3cdf71-2461-4e2f-b11f-dba0cca9c85f,network=Network(c67ab087-9504-4225-ae6f-3584d8223c4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde3cdf71-24')
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:6c:73,bridge_name='br-int',has_traffic_filtering=True,id=1f3154ad-8bf5-46a4-8184-fd6f73576d78,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f3154ad-8b') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:6c:73,bridge_name='br-int',has_traffic_filtering=True,id=1f3154ad-8bf5-46a4-8184-fd6f73576d78,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f3154ad-8b') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "59c7c418-902e-46b7-9302-5c630df18ca2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f3154ad-8b, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: INFO nova.compute.manager [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Terminating instance
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: INFO os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:6c:73,bridge_name='br-int',has_traffic_filtering=True,id=1f3154ad-8bf5-46a4-8184-fd6f73576d78,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1f3154ad-8b')
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:11:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7d4528c-dc68-49c5-ad88-00a9ea8689f8,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d4528c-dc') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:11:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7d4528c-dc68-49c5-ad88-00a9ea8689f8,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d4528c-dc') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.objects.instance [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lazy-loading 'flavor' on Instance uuid 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7d4528c-dc, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-be6b807c-2ce6-4b03-9103-20ed027f62de tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.142s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-unplugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:47 user nova-compute[82184]: WARNING nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-de3cdf71-2461-4e2f-b11f-dba0cca9c85f for instance with vm_state active and task_state deleting.
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-unplugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:47 user nova-compute[82184]: WARNING nova.compute.manager [req-3c162394-817b-4b55-842c-791e13060922 req-cada203e-d7f2-42be-b159-6f30d5eb4cda service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-b7d4528c-dc68-49c5-ad88-00a9ea8689f8 for instance with vm_state active and task_state deleting.
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: INFO os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:11:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7d4528c-dc68-49c5-ad88-00a9ea8689f8,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7d4528c-dc')
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:f0,bridge_name='br-int',has_traffic_filtering=True,id=fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb465ea4-ce') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:f0,bridge_name='br-int',has_traffic_filtering=True,id=fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb465ea4-ce') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb465ea4-ce, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: INFO os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:86:f0,bridge_name='br-int',has_traffic_filtering=True,id=fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb465ea4-ce')
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:4e,bridge_name='br-int',has_traffic_filtering=True,id=8abd0ba3-643e-45d8-ab51-c693c4b2f1f1,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abd0ba3-64') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:4e,bridge_name='br-int',has_traffic_filtering=True,id=8abd0ba3-643e-45d8-ab51-c693c4b2f1f1,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abd0ba3-64') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8abd0ba3-64, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: INFO os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:23:4e,bridge_name='br-int',has_traffic_filtering=True,id=8abd0ba3-643e-45d8-ab51-c693c4b2f1f1,network=Network(31c0d7f4-5ac9-4f95-840c-237e9eed2f04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8abd0ba3-64')
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cf:3e,bridge_name='br-int',has_traffic_filtering=True,id=3b39d5eb-3055-44f9-8be3-4cabeddd3e3f,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b39d5eb-30') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cf:3e,bridge_name='br-int',has_traffic_filtering=True,id=3b39d5eb-3055-44f9-8be3-4cabeddd3e3f,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b39d5eb-30') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b39d5eb-30, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: WARNING nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-1f3154ad-8bf5-46a4-8184-fd6f73576d78 for instance with vm_state active and task_state deleting.
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-unplugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: WARNING nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 for instance with vm_state active and task_state deleting.
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-unplugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: WARNING nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 for instance with vm_state active and task_state deleting.
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-unplugged-69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-95017d2c-dcf8-4a9c-8ce7-056e0a640dfe req-8e395a21-1a39-4cb7-8397-914034b6ee5e service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-69bce85f-9dda-4202-a608-f9c4da0cff43 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: INFO os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:cf:3e,bridge_name='br-int',has_traffic_filtering=True,id=3b39d5eb-3055-44f9-8be3-4cabeddd3e3f,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b39d5eb-30')
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1698777031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1698777031',id=10,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApFLaa/x02EL4eTjTz+moxAIRja1p8gDm3Ncr0KLPMAw5nO769Q6K7EajUuMyNHUQQFEhx8BPuuPQc+tMrIjpiCE+kmukMa/IcXGJ2zZwR2WCPhKNhhV2A/rTHq0zHpIQ==',key_name='tempest-keypair-1357527151',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3071310920ea42f9a66e1a92d6ecd324',ramdisk_id='',reservation_id='r-p65fieuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1403588062',owner_user_name='tempest-TaggedBootDevicesTest-1403588062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f288eba0f612445596edccf43f08fa22',uuid=221e01f2-18c8-468b-993b-480cdda60dd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converting VIF {"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bc:10,bridge_name='br-int',has_traffic_filtering=True,id=b744b6a0-6c5b-4c1f-b73d-c893fe058df4,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb744b6a0-6c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bc:10,bridge_name='br-int',has_traffic_filtering=True,id=b744b6a0-6c5b-4c1f-b73d-c893fe058df4,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb744b6a0-6c') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb744b6a0-6c, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: INFO os_vif [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bc:10,bridge_name='br-int',has_traffic_filtering=True,id=b744b6a0-6c5b-4c1f-b73d-c893fe058df4,network=Network(de0a436a-b743-4519-a522-2468f5ea35a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb744b6a0-6c')
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TocglzYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:48 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6226e3a-0a1f-4fce-8eb1-d85d63f2f73f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:48 user nova-compute[82184]: No targets found.
Apr 12 01:52:48 user nova-compute[82184]: iSNS:
Apr 12 01:52:48 user nova-compute[82184]: No targets found.
Apr 12 01:52:48 user nova-compute[82184]: STATIC:
Apr 12 01:52:48 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:48 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:48 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:48 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb
Apr 12 01:52:48 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:48 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:48 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:52:48 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:48 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:48 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86
Apr 12 01:52:48 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:48 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:48 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:48 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:48 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:48 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d
Apr 12 01:52:48 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:48 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:48 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8
Apr 12 01:52:48 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:48 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:48 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:48 user nova-compute[82184]: No targets found.
Apr 12 01:52:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:48 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:48 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f044c3a-ccef-41cc-95fa-ce885b167a56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9582cc5-6e4a-4cf4-b47f-a19336def715]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb (non-flash)
Apr 12 01:52:48 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b7318af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb'): ({'sdg'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Removing single pathed devices sdg {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab4e307-5460-46f1-a97e-ef40278c22df]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: WARNING nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 for instance with vm_state active and task_state deleting.
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-unplugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-unplugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-plugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Acquiring lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Lock "221e01f2-18c8-468b-993b-480cdda60dd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] No waiting events found dispatching network-vif-plugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: WARNING nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received unexpected event network-vif-plugged-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f for instance with vm_state active and task_state deleting.
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-unplugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:48 user nova-compute[82184]: WARNING nova.compute.manager [req-3fb14a05-5972-4926-b1db-97b6e3f1e1ef req-072ac15f-e45c-44f4-a7bc-bce2e904e4ae service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-efae59db-bdf2-467e-803b-c2b1a85c10a7 for instance with vm_state active and task_state deleting.
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.032s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b9b108-d390-4b40-94e1-69080d0cf765]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Flushing IO for device /dev/sdg {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdd2ea2-1541-4dc0-ac0a-0232d5b06023]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.049s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cc83f2-b5f6-4c5c-bc9c-4c3caac55c6b]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] SCSI volumes sdg have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e073b-7fc6-47e5-af84-677c95e91d6f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53b054d-da20-4ae9-b373-605244283771]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb, portal: 172.16.0.220,3260]
Apr 12 01:52:49 user nova-compute[82184]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:49 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d10e166-577b-475c-a041-3034e9e9e1cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca6a16e-6fb9-40cc-b516-b9079a5c8cbe]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] <== disconnect_volume: return (425ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iUXhmTEO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:49 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[944a977d-e634-46e2-9823-0d6a97045a9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:49 user nova-compute[82184]: No targets found.
Apr 12 01:52:49 user nova-compute[82184]: iSNS:
Apr 12 01:52:49 user nova-compute[82184]: No targets found.
Apr 12 01:52:49 user nova-compute[82184]: STATIC:
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:49 user nova-compute[82184]: No targets found.
Apr 12 01:52:49 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:49 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:49 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a977ffe-2997-4015-8795-66c19345084e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a883cdd-6d68-453c-97eb-92bab0cb31b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:49 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:49 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b7318160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d'): ({'sde'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Removing single pathed devices sde {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b07b70-846b-4828-b813-59a9abe0ef8a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cbef8b-6d6b-4509-93e7-3bdb73eb61af]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Flushing IO for device /dev/sde {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41d7abf-5b17-4bd3-be10-3a8cac313d32]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[924a8a3e-1c97-4bcf-bd56-9f58257c1621]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] SCSI volumes sde have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[08486421-3f67-4620-b5bb-69695e722171]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --logout" returned: 0 in 0.123s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89265ea-4064-41c5-9bd0-bd0d90222b45]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d, portal: 172.16.0.220,3260]
Apr 12 01:52:49 user nova-compute[82184]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:49 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78172d81-0c40-40fc-bbe3-a67e1f56081d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f67f17-a6d0-4014-86ea-bd23d507f7d0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.483s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] <== disconnect_volume: return (484ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTHVyabO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:49 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Instance destroyed successfully.
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lazy-loading 'resources' on Instance uuid 59c7c418-902e-46b7-9302-5c630df18ca2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[462908eb-25b1-4a0a-b753-169215e1ef85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:49 user nova-compute[82184]: No targets found.
Apr 12 01:52:49 user nova-compute[82184]: iSNS:
Apr 12 01:52:49 user nova-compute[82184]: No targets found.
Apr 12 01:52:49 user nova-compute[82184]: STATIC:
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8
Apr 12 01:52:49 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:49 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:49 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:49 user nova-compute[82184]: No targets found.
Apr 12 01:52:49 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:49 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:49 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:0f:f3,bridge_name='br-int',has_traffic_filtering=True,id=6ba40fff-9cc4-47e6-aae2-857a7b1b3445,network=Network(635d5017-87b6-4086-acb7-464c3f0841ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba40fff-9c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:0f:f3,bridge_name='br-int',has_traffic_filtering=True,id=6ba40fff-9cc4-47e6-aae2-857a7b1b3445,network=Network(635d5017-87b6-4086-acb7-464c3f0841ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba40fff-9c') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ba40fff-9c, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f342ea-7e83-460b-9210-4a83f3edefe0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc7e156-62b2-401d-b411-c68f096692a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:49 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:49 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:49 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a85edf30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8'): ({'sdc'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Removing single pathed devices sdc {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: INFO os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:0f:f3,bridge_name='br-int',has_traffic_filtering=True,id=6ba40fff-9cc4-47e6-aae2-857a7b1b3445,network=Network(635d5017-87b6-4086-acb7-464c3f0841ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ba40fff-9c')
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:73,bridge_name='br-int',has_traffic_filtering=True,id=69bce85f-9dda-4202-a608-f9c4da0cff43,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69bce85f-9d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:73,bridge_name='br-int',has_traffic_filtering=True,id=69bce85f-9dda-4202-a608-f9c4da0cff43,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69bce85f-9d') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a81db-70b7-4a67-81b8-0d058a9bd23d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69bce85f-9d, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[13651713-bf92-40e3-be38-683c3d85d317]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Flushing IO for device /dev/sdc {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c915413-7af2-40ce-83eb-18f5da58523f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: INFO os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:19:73,bridge_name='br-int',has_traffic_filtering=True,id=69bce85f-9dda-4202-a608-f9c4da0cff43,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap69bce85f-9d')
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:c2:8b,bridge_name='br-int',has_traffic_filtering=True,id=efae59db-bdf2-467e-803b-c2b1a85c10a7,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefae59db-bd') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c2:8b,bridge_name='br-int',has_traffic_filtering=True,id=efae59db-bdf2-467e-803b-c2b1a85c10a7,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefae59db-bd') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[55623804-1079-41b5-a307-fe5963d1725c]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefae59db-bd, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[90adc41c-c3fd-4041-92ef-aace830d4346]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: INFO os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:c2:8b,bridge_name='br-int',has_traffic_filtering=True,id=efae59db-bdf2-467e-803b-c2b1a85c10a7,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapefae59db-bd')
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:2d:bc,bridge_name='br-int',has_traffic_filtering=True,id=1834b43d-230e-4d08-8980-3415727f8b44,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1834b43d-23') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:2d:bc,bridge_name='br-int',has_traffic_filtering=True,id=1834b43d-230e-4d08-8980-3415727f8b44,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1834b43d-23') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1834b43d-23, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[669027bb-171f-4d61-a54d-7c7611160985]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8, portal: 172.16.0.220,3260]
Apr 12 01:52:49 user nova-compute[82184]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:49 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:49 user nova-compute[82184]: INFO os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:2d:bc,bridge_name='br-int',has_traffic_filtering=True,id=1834b43d-230e-4d08-8980-3415727f8b44,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1834b43d-23')
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "address": "fa:16:3e:6b:2c:bb", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ef8b50f-da", "ovs_interfaceid": "9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef8b50f-da') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef8b50f-da') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ef8b50f-da, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b8c8c2-6939-412f-a1eb-2fdd3cbbd3e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb18f9dc-a3d8-4887-a666-073c980ee8da]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] <== disconnect_volume: return (348ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:49 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Deleting instance files /opt/stack/data/nova/instances/221e01f2-18c8-468b-993b-480cdda60dd7_del
Apr 12 01:52:49 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Deletion of /opt/stack/data/nova/instances/221e01f2-18c8-468b-993b-480cdda60dd7_del complete
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: INFO os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:2c:bb,bridge_name='br-int',has_traffic_filtering=True,id=9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9,network=Network(c82cca19-2f7b-4cdd-8fff-a7549f75492e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ef8b50f-da')
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:b6:c6,bridge_name='br-int',has_traffic_filtering=True,id=3862628b-e679-40e9-ba14-5aaab53bb289,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3862628b-e6') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:b6:c6,bridge_name='br-int',has_traffic_filtering=True,id=3862628b-e679-40e9-ba14-5aaab53bb289,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3862628b-e6') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3862628b-e6, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-unplugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:49 user nova-compute[82184]: WARNING nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 for instance with vm_state active and task_state deleting.
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-unplugged-3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-3862628b-e679-40e9-ba14-5aaab53bb289 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:49 user nova-compute[82184]: WARNING nova.compute.manager [req-8aeb34a7-adb6-4755-aa37-f6e1eefa3342 req-4d666761-b766-482a-a185-9e385ec26a69 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-3862628b-e679-40e9-ba14-5aaab53bb289 for instance with vm_state active and task_state deleting.
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: INFO os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:b6:c6,bridge_name='br-int',has_traffic_filtering=True,id=3862628b-e679-40e9-ba14-5aaab53bb289,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3862628b-e6')
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1664937775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1664937775',id=11,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUH4LNxTqx2L62GMVH41PI3IO5q8s9r5Mr8h4YxEzFjxPQNGwWmbswGDWvoP2aOF7udl4Xw+VUjc6jdYHoY2mt1HtgRap0+LKKZX+JXTb8LirKaWn1HwhSxxvs6pK4Zlg==',key_name='tempest-keypair-1066267509',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85c85b2820514000b08e47046f7bd717',ramdisk_id='',reservation_id='r-i0zfcs1c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1956984568',owner_user_name='tempest-TaggedBootDevicesTest_v242-1956984568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa19aa56b6ee4a10a07eb6e421a131bd',uuid=59c7c418-902e-46b7-9302-5c630df18ca2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converting VIF {"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:61:db,bridge_name='br-int',has_traffic_filtering=True,id=890247d7-ec5c-429e-beef-5666b669f4f3,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890247d7-ec') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:61:db,bridge_name='br-int',has_traffic_filtering=True,id=890247d7-ec5c-429e-beef-5666b669f4f3,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890247d7-ec') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap890247d7-ec, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:49 user nova-compute[82184]: INFO os_vif [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:61:db,bridge_name='br-int',has_traffic_filtering=True,id=890247d7-ec5c-429e-beef-5666b669f4f3,network=Network(2db9de15-fcb7-46ee-97c9-9d16ad878543),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap890247d7-ec')
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uiNAbIkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:49 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:49 user nova-compute[82184]: INFO nova.compute.manager [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Took 4.22 seconds to destroy the instance on the hypervisor.
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:52:49 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[955eae0b-8f22-4bd2-8953-107c1c588a47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:50 user nova-compute[82184]: No targets found.
Apr 12 01:52:50 user nova-compute[82184]: iSNS:
Apr 12 01:52:50 user nova-compute[82184]: No targets found.
Apr 12 01:52:50 user nova-compute[82184]: STATIC:
Apr 12 01:52:50 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:50 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:50 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:50 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:52:50 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:50 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:50 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86
Apr 12 01:52:50 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:50 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:50 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:50 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:50 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:50 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:50 user nova-compute[82184]: No targets found.
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:50 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:50 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd8d351-de6e-477c-af98-aa7d1de4a11b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[677e9aa1-ea3e-42c0-b662-8fa0d41721c5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a81e1360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02ea16b-157d-4fa7-b726-343cd6beed22]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0535df9-ee53-4733-b2af-1dc819766c76]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aba9a1a-afe6-4d96-9832-7c8c13d0e8e6]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f30ab5-200f-4060-af12-6ceabbe39bf5]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec243e6-10a1-4023-a27c-e454132f8090]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e5cfcb-ada3-4e24-ac07-f81fd08bda84]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86, portal: 172.16.0.220,3260]
Apr 12 01:52:50 user nova-compute[82184]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14875542-8ecd-404c-b962-08b834eacb86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10961a6-9cba-4114-bfcf-1da97de410a9]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] <== disconnect_volume: return (371ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqdwkfas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:50 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0e98f3-d675-4161-8b7f-695e9bdb637e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:50 user nova-compute[82184]: No targets found.
Apr 12 01:52:50 user nova-compute[82184]: iSNS:
Apr 12 01:52:50 user nova-compute[82184]: No targets found.
Apr 12 01:52:50 user nova-compute[82184]: STATIC:
Apr 12 01:52:50 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:50 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:50 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:50 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7
Apr 12 01:52:50 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:50 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:50 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:50 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:50 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:50 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:50 user nova-compute[82184]: No targets found.
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:50 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:50 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02cc6c6-f9be-4c85-86dc-ce554499cd6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e746a7e-0d87-4db9-9802-65bf9ebadd3d]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b731a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7'): ({'sdd'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Removing single pathed devices sdd {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-69bce85f-9dda-4202-a608-f9c4da0cff43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:50 user nova-compute[82184]: WARNING nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-69bce85f-9dda-4202-a608-f9c4da0cff43 for instance with vm_state active and task_state deleting.
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-unplugged-1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-1834b43d-230e-4d08-8980-3415727f8b44 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:50 user nova-compute[82184]: WARNING nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-1834b43d-230e-4d08-8980-3415727f8b44 for instance with vm_state active and task_state deleting.
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-unplugged-890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-890247d7-ec5c-429e-beef-5666b669f4f3 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:50 user nova-compute[82184]: WARNING nova.compute.manager [req-da532fdc-5b36-4ecc-9fcf-de24ae2e7f75 req-d86225c2-ab83-40e4-9885-56c63e4220d9 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-890247d7-ec5c-429e-beef-5666b669f4f3 for instance with vm_state active and task_state deleting.
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee4ef9f-1b13-449f-ae19-d8201c62efbd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85ad650-4e02-4a27-a4f2-17cf3569c5b9]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Flushing IO for device /dev/sdd {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9686691-fa4c-435b-9a31-faf61c00d97d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5083144-c4a6-4eb9-9d15-eb97631825cb]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcad8dc1-3206-4ba7-bf66-26b2f4518272]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abd6d97-7e7a-4912-a795-813a3994a17a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7, portal: 172.16.0.220,3260]
Apr 12 01:52:50 user nova-compute[82184]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65104dd2-34df-439c-9659-ca5448f7fda7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b89e22-9762-4d34-91bd-49a5f8ea0743]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] <== disconnect_volume: return (362ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gDKTiqWy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:52:50 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c589d3-044f-4391-b669-4c8486878c97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:52:50 user nova-compute[82184]: No targets found.
Apr 12 01:52:50 user nova-compute[82184]: iSNS:
Apr 12 01:52:50 user nova-compute[82184]: No targets found.
Apr 12 01:52:50 user nova-compute[82184]: STATIC:
Apr 12 01:52:50 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:52:50 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:50 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:50 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7
Apr 12 01:52:50 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:52:50 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:52:50 user nova-compute[82184]: FIRMWARE:
Apr 12 01:52:50 user nova-compute[82184]: No targets found.
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:52:50 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:52:50 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ab07ce-49ec-481e-a263-4937ab2df569]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c8f887-4c34-4491-a2e0-0b4240e97972]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 (non-flash)
Apr 12 01:52:50 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:52:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b731a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7'): ({'sdf'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Removing single pathed devices sdf {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a00f85c-a3ca-42d8-8bb0-b9c57db86a3d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-unplugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-unplugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-plugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] Acquiring lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] Lock "59c7c418-902e-46b7-9302-5c630df18ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] No waiting events found dispatching network-vif-plugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:52:50 user nova-compute[82184]: WARNING nova.compute.manager [req-d604541c-dc9b-4d0f-9045-8080175213bb req-12f35bdd-faab-45d5-9bd7-f40f4c6fe270 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received unexpected event network-vif-plugged-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 for instance with vm_state active and task_state deleting.
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a9e065-2ca3-4501-8b44-4c8fa57841c7]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Flushing IO for device /dev/sdf {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96739827-169a-40ab-b96b-c0dbc9516392]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b83be-2884-4ca4-a395-4dccfa04a967]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] SCSI volumes sdf have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8cefb1-5870-4423-b6ab-9d0b74b93342]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb040d9-4391-4269-9a52-036e4aae9639]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7, portal: 172.16.0.220,3260]
Apr 12 01:52:51 user nova-compute[82184]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7, portal: 172.16.0.220,3260] successful.
Apr 12 01:52:51 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65567a69-c266-48ba-942d-183231131ad7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60d1fbe-07f3-46f2-8160-dcff8b4f5c3e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] <== disconnect_volume: return (305ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:52:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Deleting instance files /opt/stack/data/nova/instances/59c7c418-902e-46b7-9302-5c630df18ca2_del
Apr 12 01:52:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Deletion of /opt/stack/data/nova/instances/59c7c418-902e-46b7-9302-5c630df18ca2_del complete
Apr 12 01:52:51 user nova-compute[82184]: INFO nova.compute.manager [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Took 3.32 seconds to destroy the instance on the hypervisor.
Apr 12 01:52:51 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:52:51 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:52:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-cc717d5c-bcb4-42b1-8565-e69a3e9fb3af req-563525fe-3a5a-41a8-a92a-3b983d20d014 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-deleted-de3cdf71-2461-4e2f-b11f-dba0cca9c85f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:52 user nova-compute[82184]: INFO nova.compute.manager [req-cc717d5c-bcb4-42b1-8565-e69a3e9fb3af req-563525fe-3a5a-41a8-a92a-3b983d20d014 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Neutron deleted interface de3cdf71-2461-4e2f-b11f-dba0cca9c85f; detaching it from the instance and deleting it from the info cache
Apr 12 01:52:52 user nova-compute[82184]: DEBUG nova.network.neutron [req-cc717d5c-bcb4-42b1-8565-e69a3e9fb3af req-563525fe-3a5a-41a8-a92a-3b983d20d014 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [{"id": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "address": "fa:16:3e:42:6c:73", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.160", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f3154ad-8b", "ovs_interfaceid": "1f3154ad-8bf5-46a4-8184-fd6f73576d78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "address": "fa:16:3e:93:11:ac", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.119", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d4528c-dc", "ovs_interfaceid": "b7d4528c-dc68-49c5-ad88-00a9ea8689f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "address": "fa:16:3e:1b:86:f0", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb465ea4-ce", "ovs_interfaceid": "fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "address": "fa:16:3e:b2:23:4e", "network": {"id": "31c0d7f4-5ac9-4f95-840c-237e9eed2f04", "bridge": "br-int", "label": "tempest-device-tagging-net1-1202903542", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8abd0ba3-64", "ovs_interfaceid": "8abd0ba3-643e-45d8-ab51-c693c4b2f1f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "address": "fa:16:3e:e5:cf:3e", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b39d5eb-30", "ovs_interfaceid": "3b39d5eb-3055-44f9-8be3-4cabeddd3e3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "address": "fa:16:3e:6e:bc:10", "network": {"id": "de0a436a-b743-4519-a522-2468f5ea35a1", "bridge": "br-int", "label": "tempest-device-tagging-net2-191795331", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3071310920ea42f9a66e1a92d6ecd324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb744b6a0-6c", "ovs_interfaceid": "b744b6a0-6c5b-4c1f-b73d-c893fe058df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-cc717d5c-bcb4-42b1-8565-e69a3e9fb3af req-563525fe-3a5a-41a8-a92a-3b983d20d014 service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Detach interface failed, port_id=de3cdf71-2461-4e2f-b11f-dba0cca9c85f, reason: Instance 221e01f2-18c8-468b-993b-480cdda60dd7 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:52:53 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:53 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Took 3.60 seconds to deallocate network for instance.
Apr 12 01:52:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-8c2e4c1d-87f8-4a7f-8950-8ba3bb264fef req-870a030e-098c-47a6-a041-95f8c5e5c14b service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-deleted-9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:53 user nova-compute[82184]: INFO nova.compute.manager [req-8c2e4c1d-87f8-4a7f-8950-8ba3bb264fef req-870a030e-098c-47a6-a041-95f8c5e5c14b service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Neutron deleted interface 9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9; detaching it from the instance and deleting it from the info cache
Apr 12 01:52:53 user nova-compute[82184]: DEBUG nova.network.neutron [req-8c2e4c1d-87f8-4a7f-8950-8ba3bb264fef req-870a030e-098c-47a6-a041-95f8c5e5c14b service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [{"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "890247d7-ec5c-429e-beef-5666b669f4f3", "address": "fa:16:3e:93:61:db", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap890247d7-ec", "ovs_interfaceid": "890247d7-ec5c-429e-beef-5666b669f4f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-8c2e4c1d-87f8-4a7f-8950-8ba3bb264fef req-870a030e-098c-47a6-a041-95f8c5e5c14b service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Detach interface failed, port_id=9ef8b50f-dabb-4937-a6a2-a31cae6f5bc9, reason: Instance 59c7c418-902e-46b7-9302-5c630df18ca2 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:52:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-08a4d30f-066a-4463-8858-a1cd9b1808c4 req-ba0e254a-6fa6-4ecc-b1eb-7029a0d33e3e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-deleted-fb465ea4-ce8b-43f6-bc13-0cf66dbc0d43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-08a4d30f-066a-4463-8858-a1cd9b1808c4 req-ba0e254a-6fa6-4ecc-b1eb-7029a0d33e3e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-deleted-3b39d5eb-3055-44f9-8be3-4cabeddd3e3f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-08a4d30f-066a-4463-8858-a1cd9b1808c4 req-ba0e254a-6fa6-4ecc-b1eb-7029a0d33e3e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-deleted-b744b6a0-6c5b-4c1f-b73d-c893fe058df4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-08a4d30f-066a-4463-8858-a1cd9b1808c4 req-ba0e254a-6fa6-4ecc-b1eb-7029a0d33e3e service nova] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Received event network-vif-deleted-8abd0ba3-643e-45d8-ab51-c693c4b2f1f1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-deleted-890247d7-ec5c-429e-beef-5666b669f4f3 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:56 user nova-compute[82184]: INFO nova.compute.manager [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Neutron deleted interface 890247d7-ec5c-429e-beef-5666b669f4f3; detaching it from the instance and deleting it from the info cache
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.network.neutron [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [{"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3862628b-e679-40e9-ba14-5aaab53bb289", "address": "fa:16:3e:1b:b6:c6", "network": {"id": "2db9de15-fcb7-46ee-97c9-9d16ad878543", "bridge": "br-int", "label": "tempest-device-tagging-net2-1748857568", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3862628b-e6", "ovs_interfaceid": "3862628b-e679-40e9-ba14-5aaab53bb289", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Detach interface failed, port_id=890247d7-ec5c-429e-beef-5666b669f4f3, reason: Instance 59c7c418-902e-46b7-9302-5c630df18ca2 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-deleted-3862628b-e679-40e9-ba14-5aaab53bb289 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:56 user nova-compute[82184]: INFO nova.compute.manager [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Neutron deleted interface 3862628b-e679-40e9-ba14-5aaab53bb289; detaching it from the instance and deleting it from the info cache
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.network.neutron [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [{"id": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "address": "fa:16:3e:a7:0f:f3", "network": {"id": "635d5017-87b6-4086-acb7-464c3f0841ee", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-961395343-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ba40fff-9c", "ovs_interfaceid": "6ba40fff-9cc4-47e6-aae2-857a7b1b3445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:56 user nova-compute[82184]: INFO nova.compute.manager [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Took 2.51 seconds to detach 3 volumes for instance.
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Detach interface failed, port_id=3862628b-e679-40e9-ba14-5aaab53bb289, reason: Instance 59c7c418-902e-46b7-9302-5c630df18ca2 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-deleted-6ba40fff-9cc4-47e6-aae2-857a7b1b3445 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:56 user nova-compute[82184]: INFO nova.compute.manager [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Neutron deleted interface 6ba40fff-9cc4-47e6-aae2-857a7b1b3445; detaching it from the instance and deleting it from the info cache
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.network.neutron [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [{"id": "69bce85f-9dda-4202-a608-f9c4da0cff43", "address": "fa:16:3e:94:19:73", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69bce85f-9d", "ovs_interfaceid": "69bce85f-9dda-4202-a608-f9c4da0cff43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "address": "fa:16:3e:07:c2:8b", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefae59db-bd", "ovs_interfaceid": "efae59db-bdf2-467e-803b-c2b1a85c10a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1834b43d-230e-4d08-8980-3415727f8b44", "address": "fa:16:3e:2a:2d:bc", "network": {"id": "c82cca19-2f7b-4cdd-8fff-a7549f75492e", "bridge": "br-int", "label": "tempest-device-tagging-net1-451899785", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "85c85b2820514000b08e47046f7bd717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1834b43d-23", "ovs_interfaceid": "1834b43d-230e-4d08-8980-3415727f8b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-14557e55-c9be-44c3-b6be-9c0e604568e6 req-f4d1bd6f-0734-4979-92e9-714106d08a03 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Detach interface failed, port_id=6ba40fff-9cc4-47e6-aae2-857a7b1b3445, reason: Instance 59c7c418-902e-46b7-9302-5c630df18ca2 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:52:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:52:56 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Took 5.19 seconds to deallocate network for instance.
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:52:56 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:52:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:56 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Deleted allocations for instance 221e01f2-18c8-468b-993b-480cdda60dd7
Apr 12 01:52:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9b00bf32-a814-404b-9ee1-1e5e326d1ed5 tempest-TaggedBootDevicesTest-1403588062 tempest-TaggedBootDevicesTest-1403588062-project-member] Lock "221e01f2-18c8-468b-993b-480cdda60dd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.847s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-bd8a2cba-0eb8-4f0a-9dfb-deed883a7c9d req-7fa3aa14-da9d-442c-b704-a90c523e42d6 service nova] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Received event network-vif-deleted-1834b43d-230e-4d08-8980-3415727f8b44 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:52:58 user nova-compute[82184]: INFO nova.compute.manager [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Took 2.47 seconds to detach 3 volumes for instance.
Apr 12 01:52:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:52:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:52:59 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:52:59 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:52:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:59 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Deleted allocations for instance 59c7c418-902e-46b7-9302-5c630df18ca2
Apr 12 01:52:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4513b53b-77e7-4636-904f-8e1221a8adf8 tempest-TaggedBootDevicesTest_v242-1956984568 tempest-TaggedBootDevicesTest_v242-1956984568-project-member] Lock "59c7c418-902e-46b7-9302-5c630df18ca2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.495s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:52:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:02 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264367.6380541, 221e01f2-18c8-468b-993b-480cdda60dd7 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:02 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] VM Stopped (Lifecycle Event)
Apr 12 01:53:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e084848e-4ea7-493b-a9b4-1f2c3a9c9469 None None] [instance: 221e01f2-18c8-468b-993b-480cdda60dd7] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:04 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264369.5564325, 59c7c418-902e-46b7-9302-5c630df18ca2 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:04 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] VM Stopped (Lifecycle Event)
Apr 12 01:53:04 user nova-compute[82184]: DEBUG nova.compute.manager [None req-20b6546f-c7b5-4bef-b9b2-7bceeea7c100 None None] [instance: 59c7c418-902e-46b7-9302-5c630df18ca2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:53:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:53:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:53:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:53:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:53:11 user nova-compute[82184]: INFO nova.compute.claims [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Claim successful on node user
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:53:12 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.policy [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aeb7fd40946e43dc860d63bb8958d633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0dd135bd60941dbb68b3e677c4878e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:53:12 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Creating image(s)
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "/opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "/opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "/opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk 1073741824" returned: 0 in 0.050s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Successfully created port: d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Cannot resize image /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.objects.instance [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lazy-loading 'migration_context' on Instance uuid 2acd2ee1-172a-4984-85ed-52a8e78aafb9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Ensure instance console log exists: /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Successfully updated port: d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:53:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "refresh_cache-2acd2ee1-172a-4984-85ed-52a8e78aafb9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:53:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquired lock "refresh_cache-2acd2ee1-172a-4984-85ed-52a8e78aafb9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:53:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:53:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-e2161f6f-8a02-48e9-9401-4f970ab1cec7 req-4da29092-fdb4-4347-a335-3d4f2b302e48 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received event network-changed-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-e2161f6f-8a02-48e9-9401-4f970ab1cec7 req-4da29092-fdb4-4347-a335-3d4f2b302e48 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Refreshing instance network info cache due to event network-changed-d01d48de-8685-4de9-a1d2-e13833a4b274. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:53:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e2161f6f-8a02-48e9-9401-4f970ab1cec7 req-4da29092-fdb4-4347-a335-3d4f2b302e48 service nova] Acquiring lock "refresh_cache-2acd2ee1-172a-4984-85ed-52a8e78aafb9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:53:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Updating instance_info_cache with network_info: [{"id": "d01d48de-8685-4de9-a1d2-e13833a4b274", "address": "fa:16:3e:0b:9a:18", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01d48de-86", "ovs_interfaceid": "d01d48de-8685-4de9-a1d2-e13833a4b274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Releasing lock "refresh_cache-2acd2ee1-172a-4984-85ed-52a8e78aafb9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Instance network_info: |[{"id": "d01d48de-8685-4de9-a1d2-e13833a4b274", "address": "fa:16:3e:0b:9a:18", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01d48de-86", "ovs_interfaceid": "d01d48de-8685-4de9-a1d2-e13833a4b274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e2161f6f-8a02-48e9-9401-4f970ab1cec7 req-4da29092-fdb4-4347-a335-3d4f2b302e48 service nova] Acquired lock "refresh_cache-2acd2ee1-172a-4984-85ed-52a8e78aafb9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.network.neutron [req-e2161f6f-8a02-48e9-9401-4f970ab1cec7 req-4da29092-fdb4-4347-a335-3d4f2b302e48 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Refreshing network info cache for port d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Start _get_guest_xml network_info=[{"id": "d01d48de-8685-4de9-a1d2-e13833a4b274", "address": "fa:16:3e:0b:9a:18", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01d48de-86", "ovs_interfaceid": "d01d48de-8685-4de9-a1d2-e13833a4b274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:53:14 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:53:14 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-842559334',display_name='tempest-VolumesAdminNegativeTest-server-842559334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-842559334',id=13,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0dd135bd60941dbb68b3e677c4878e9',ramdisk_id='',reservation_id='r-4vpdbi6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-312412096',owner_user_name='tempest-VolumesAdminNegativeTest-312412096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:53:12Z,user_data=None,user_id='aeb7fd40946e43dc860d63bb8958d633',uuid=2acd2ee1-172a-4984-85ed-52a8e78aafb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d01d48de-8685-4de9-a1d2-e13833a4b274", "address": "fa:16:3e:0b:9a:18", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01d48de-86", "ovs_interfaceid": "d01d48de-8685-4de9-a1d2-e13833a4b274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converting VIF {"id": "d01d48de-8685-4de9-a1d2-e13833a4b274", "address": "fa:16:3e:0b:9a:18", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01d48de-86", "ovs_interfaceid": "d01d48de-8685-4de9-a1d2-e13833a4b274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9a:18,bridge_name='br-int',has_traffic_filtering=True,id=d01d48de-8685-4de9-a1d2-e13833a4b274,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01d48de-86') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.objects.instance [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lazy-loading 'pci_devices' on Instance uuid 2acd2ee1-172a-4984-85ed-52a8e78aafb9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:53:14 user nova-compute[82184]:   <uuid>2acd2ee1-172a-4984-85ed-52a8e78aafb9</uuid>
Apr 12 01:53:14 user nova-compute[82184]:   <name>instance-0000000d</name>
Apr 12 01:53:14 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:53:14 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:53:14 user nova-compute[82184]:   <metadata>
Apr 12 01:53:14 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:53:14 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:53:14 user nova-compute[82184]:       <nova:name>tempest-VolumesAdminNegativeTest-server-842559334</nova:name>
Apr 12 01:53:14 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:53:14</nova:creationTime>
Apr 12 01:53:14 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:53:14 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:53:14 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:53:14 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:53:14 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:53:14 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:53:14 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:53:14 user nova-compute[82184]:       <nova:owner>
Apr 12 01:53:14 user nova-compute[82184]:         <nova:user uuid="aeb7fd40946e43dc860d63bb8958d633">tempest-VolumesAdminNegativeTest-312412096-project-member</nova:user>
Apr 12 01:53:14 user nova-compute[82184]:         <nova:project uuid="d0dd135bd60941dbb68b3e677c4878e9">tempest-VolumesAdminNegativeTest-312412096</nova:project>
Apr 12 01:53:14 user nova-compute[82184]:       </nova:owner>
Apr 12 01:53:14 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:53:14 user nova-compute[82184]:       <nova:ports>
Apr 12 01:53:14 user nova-compute[82184]:         <nova:port uuid="d01d48de-8685-4de9-a1d2-e13833a4b274">
Apr 12 01:53:14 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 01:53:14 user nova-compute[82184]:         </nova:port>
Apr 12 01:53:14 user nova-compute[82184]:       </nova:ports>
Apr 12 01:53:14 user nova-compute[82184]:     </nova:instance>
Apr 12 01:53:14 user nova-compute[82184]:   </metadata>
Apr 12 01:53:14 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:53:14 user nova-compute[82184]:     <system>
Apr 12 01:53:14 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:53:14 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:53:14 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:53:14 user nova-compute[82184]:       <entry name="serial">2acd2ee1-172a-4984-85ed-52a8e78aafb9</entry>
Apr 12 01:53:14 user nova-compute[82184]:       <entry name="uuid">2acd2ee1-172a-4984-85ed-52a8e78aafb9</entry>
Apr 12 01:53:14 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:53:14 user nova-compute[82184]:     </system>
Apr 12 01:53:14 user nova-compute[82184]:   </sysinfo>
Apr 12 01:53:14 user nova-compute[82184]:   <os>
Apr 12 01:53:14 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:53:14 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:53:14 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:53:14 user nova-compute[82184]:   </os>
Apr 12 01:53:14 user nova-compute[82184]:   <features>
Apr 12 01:53:14 user nova-compute[82184]:     <acpi/>
Apr 12 01:53:14 user nova-compute[82184]:     <apic/>
Apr 12 01:53:14 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:53:14 user nova-compute[82184]:   </features>
Apr 12 01:53:14 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:53:14 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:53:14 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:53:14 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:53:14 user nova-compute[82184]:   </clock>
Apr 12 01:53:14 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:53:14 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:53:14 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:53:14 user nova-compute[82184]:   </cpu>
Apr 12 01:53:14 user nova-compute[82184]:   <devices>
Apr 12 01:53:14 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:53:14 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:53:14 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk"/>
Apr 12 01:53:14 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:53:14 user nova-compute[82184]:     </disk>
Apr 12 01:53:14 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:53:14 user nova-compute[82184]:       <mac address="fa:16:3e:0b:9a:18"/>
Apr 12 01:53:14 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:53:14 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:53:14 user nova-compute[82184]:       <target dev="tapd01d48de-86"/>
Apr 12 01:53:14 user nova-compute[82184]:     </interface>
Apr 12 01:53:14 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:53:14 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/console.log" append="off"/>
Apr 12 01:53:14 user nova-compute[82184]:     </serial>
Apr 12 01:53:14 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:53:14 user nova-compute[82184]:     <video>
Apr 12 01:53:14 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:53:14 user nova-compute[82184]:     </video>
Apr 12 01:53:14 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:53:14 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:53:14 user nova-compute[82184]:     </rng>
Apr 12 01:53:14 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:53:14 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:53:14 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:53:14 user nova-compute[82184]:     </memballoon>
Apr 12 01:53:14 user nova-compute[82184]:   </devices>
Apr 12 01:53:14 user nova-compute[82184]: </domain>
Apr 12 01:53:14 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-842559334',display_name='tempest-VolumesAdminNegativeTest-server-842559334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-842559334',id=13,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0dd135bd60941dbb68b3e677c4878e9',ramdisk_id='',reservation_id='r-4vpdbi6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-312412096',owner_user_name='tempest-VolumesAdminNegativeTest-312412096-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:53:12Z,user_data=None,user_id='aeb7fd40946e43dc860d63bb8958d633',uuid=2acd2ee1-172a-4984-85ed-52a8e78aafb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d01d48de-8685-4de9-a1d2-e13833a4b274", "address": "fa:16:3e:0b:9a:18", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01d48de-86", "ovs_interfaceid": "d01d48de-8685-4de9-a1d2-e13833a4b274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converting VIF {"id": "d01d48de-8685-4de9-a1d2-e13833a4b274", "address": "fa:16:3e:0b:9a:18", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01d48de-86", "ovs_interfaceid": "d01d48de-8685-4de9-a1d2-e13833a4b274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9a:18,bridge_name='br-int',has_traffic_filtering=True,id=d01d48de-8685-4de9-a1d2-e13833a4b274,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01d48de-86') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG os_vif [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9a:18,bridge_name='br-int',has_traffic_filtering=True,id=d01d48de-8685-4de9-a1d2-e13833a4b274,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01d48de-86') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd01d48de-86, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd01d48de-86, col_values=(('external_ids', {'iface-id': 'd01d48de-8685-4de9-a1d2-e13833a4b274', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:9a:18', 'vm-uuid': '2acd2ee1-172a-4984-85ed-52a8e78aafb9'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:14 user nova-compute[82184]: INFO os_vif [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9a:18,bridge_name='br-int',has_traffic_filtering=True,id=d01d48de-8685-4de9-a1d2-e13833a4b274,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01d48de-86')
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:53:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] No VIF found with MAC fa:16:3e:0b:9a:18, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:53:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-e2161f6f-8a02-48e9-9401-4f970ab1cec7 req-4da29092-fdb4-4347-a335-3d4f2b302e48 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Updated VIF entry in instance network info cache for port d01d48de-8685-4de9-a1d2-e13833a4b274. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:53:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-e2161f6f-8a02-48e9-9401-4f970ab1cec7 req-4da29092-fdb4-4347-a335-3d4f2b302e48 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Updating instance_info_cache with network_info: [{"id": "d01d48de-8685-4de9-a1d2-e13833a4b274", "address": "fa:16:3e:0b:9a:18", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01d48de-86", "ovs_interfaceid": "d01d48de-8685-4de9-a1d2-e13833a4b274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e2161f6f-8a02-48e9-9401-4f970ab1cec7 req-4da29092-fdb4-4347-a335-3d4f2b302e48 service nova] Releasing lock "refresh_cache-2acd2ee1-172a-4984-85ed-52a8e78aafb9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-79498ef5-30ce-46d2-8a7f-23c6fd13861c req-998fb3e9-21b6-4d85-922a-7118ca6df642 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-79498ef5-30ce-46d2-8a7f-23c6fd13861c req-998fb3e9-21b6-4d85-922a-7118ca6df642 service nova] Acquiring lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-79498ef5-30ce-46d2-8a7f-23c6fd13861c req-998fb3e9-21b6-4d85-922a-7118ca6df642 service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-79498ef5-30ce-46d2-8a7f-23c6fd13861c req-998fb3e9-21b6-4d85-922a-7118ca6df642 service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-79498ef5-30ce-46d2-8a7f-23c6fd13861c req-998fb3e9-21b6-4d85-922a-7118ca6df642 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] No waiting events found dispatching network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:16 user nova-compute[82184]: WARNING nova.compute.manager [req-79498ef5-30ce-46d2-8a7f-23c6fd13861c req-998fb3e9-21b6-4d85-922a-7118ca6df642 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received unexpected event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 for instance with vm_state building and task_state spawning.
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264398.2235148, 2acd2ee1-172a-4984-85ed-52a8e78aafb9 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] VM Resumed (Lifecycle Event)
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:53:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Instance spawned successfully.
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264398.224756, 2acd2ee1-172a-4984-85ed-52a8e78aafb9 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] VM Started (Lifecycle Event)
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:53:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:53:18 user nova-compute[82184]: INFO nova.compute.manager [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Took 6.05 seconds to spawn the instance on the hypervisor.
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:18 user nova-compute[82184]: INFO nova.compute.manager [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Took 6.79 seconds to build instance.
Apr 12 01:53:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bddd3bec-874d-44cf-abf7-e565ff972343 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.884s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-b020f019-abc2-4ba6-9535-382321a3d97c req-5dba86fe-3892-402f-b8eb-35e6e5534a7f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b020f019-abc2-4ba6-9535-382321a3d97c req-5dba86fe-3892-402f-b8eb-35e6e5534a7f service nova] Acquiring lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b020f019-abc2-4ba6-9535-382321a3d97c req-5dba86fe-3892-402f-b8eb-35e6e5534a7f service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b020f019-abc2-4ba6-9535-382321a3d97c req-5dba86fe-3892-402f-b8eb-35e6e5534a7f service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-b020f019-abc2-4ba6-9535-382321a3d97c req-5dba86fe-3892-402f-b8eb-35e6e5534a7f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] No waiting events found dispatching network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:18 user nova-compute[82184]: WARNING nova.compute.manager [req-b020f019-abc2-4ba6-9535-382321a3d97c req-5dba86fe-3892-402f-b8eb-35e6e5534a7f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received unexpected event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 for instance with vm_state active and task_state None.
Apr 12 01:53:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Acquiring lock "fd946144-5343-4788-b04d-ca1ed81afce9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "fd946144-5343-4788-b04d-ca1ed81afce9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:53:30 user nova-compute[82184]: INFO nova.compute.claims [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Claim successful on node user
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.network.neutron [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:53:30 user nova-compute[82184]: INFO nova.compute.claims [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Claim successful on node user
Apr 12 01:53:30 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:53:30 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Creating image(s)
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "/opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "/opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG nova.policy [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a92cd627a1c04cedacc4aa3e2398b960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e80d0c6d6f44c786b1053c0547de3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.157s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk 1073741824" returned: 0 in 0.047s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:53:31 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Cannot resize image /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.objects.instance [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lazy-loading 'migration_context' on Instance uuid fd946144-5343-4788-b04d-ca1ed81afce9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Ensure instance console log exists: /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.policy [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d876b30b1724669a8d7e8bd543fa18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce361b6fa374bca8dc0a48a53ad54f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:53:31 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Creating image(s)
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "/opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "/opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG nova.network.neutron [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Successfully created port: 3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk 1073741824" returned: 0 in 0.049s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.150s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Successfully created port: 0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Cannot resize image /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lazy-loading 'migration_context' on Instance uuid 9fa9bdbe-ee75-425e-bed5-049fdf908d09 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Ensure instance console log exists: /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.neutron [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Successfully updated port: 3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Acquiring lock "refresh_cache-fd946144-5343-4788-b04d-ca1ed81afce9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Acquired lock "refresh_cache-fd946144-5343-4788-b04d-ca1ed81afce9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.neutron [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-f73998a4-da28-4f23-9198-3727efbed563 req-ed96152f-0b36-4a40-a735-ce2984d11585 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Received event network-changed-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-f73998a4-da28-4f23-9198-3727efbed563 req-ed96152f-0b36-4a40-a735-ce2984d11585 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Refreshing instance network info cache due to event network-changed-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f73998a4-da28-4f23-9198-3727efbed563 req-ed96152f-0b36-4a40-a735-ce2984d11585 service nova] Acquiring lock "refresh_cache-fd946144-5343-4788-b04d-ca1ed81afce9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.neutron [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.neutron [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Updating instance_info_cache with network_info: [{"id": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "address": "fa:16:3e:10:f9:ee", "network": {"id": "519f5539-952c-455f-aae3-420bb4c92b09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1460084896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "32e80d0c6d6f44c786b1053c0547de3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aae11f1-3c", "ovs_interfaceid": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Releasing lock "refresh_cache-fd946144-5343-4788-b04d-ca1ed81afce9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Instance network_info: |[{"id": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "address": "fa:16:3e:10:f9:ee", "network": {"id": "519f5539-952c-455f-aae3-420bb4c92b09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1460084896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "32e80d0c6d6f44c786b1053c0547de3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aae11f1-3c", "ovs_interfaceid": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f73998a4-da28-4f23-9198-3727efbed563 req-ed96152f-0b36-4a40-a735-ce2984d11585 service nova] Acquired lock "refresh_cache-fd946144-5343-4788-b04d-ca1ed81afce9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.neutron [req-f73998a4-da28-4f23-9198-3727efbed563 req-ed96152f-0b36-4a40-a735-ce2984d11585 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Refreshing network info cache for port 3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Start _get_guest_xml network_info=[{"id": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "address": "fa:16:3e:10:f9:ee", "network": {"id": "519f5539-952c-455f-aae3-420bb4c92b09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1460084896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "32e80d0c6d6f44c786b1053c0547de3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aae11f1-3c", "ovs_interfaceid": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:53:32 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:53:32 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1114639621',display_name='tempest-VolumesActionsTest-instance-1114639621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1114639621',id=14,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32e80d0c6d6f44c786b1053c0547de3b',ramdisk_id='',reservation_id='r-uuohpjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-621357222',owner_user_name='tempest-VolumesActionsTest-621357222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:53:31Z,user_data=None,user_id='a92cd627a1c04cedacc4aa3e2398b960',uuid=fd946144-5343-4788-b04d-ca1ed81afce9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "address": "fa:16:3e:10:f9:ee", "network": {"id": "519f5539-952c-455f-aae3-420bb4c92b09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1460084896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "32e80d0c6d6f44c786b1053c0547de3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aae11f1-3c", "ovs_interfaceid": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Converting VIF {"id": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "address": "fa:16:3e:10:f9:ee", "network": {"id": "519f5539-952c-455f-aae3-420bb4c92b09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1460084896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "32e80d0c6d6f44c786b1053c0547de3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aae11f1-3c", "ovs_interfaceid": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:ee,bridge_name='br-int',has_traffic_filtering=True,id=3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e,network=Network(519f5539-952c-455f-aae3-420bb4c92b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aae11f1-3c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.objects.instance [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lazy-loading 'pci_devices' on Instance uuid fd946144-5343-4788-b04d-ca1ed81afce9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:53:32 user nova-compute[82184]:   <uuid>fd946144-5343-4788-b04d-ca1ed81afce9</uuid>
Apr 12 01:53:32 user nova-compute[82184]:   <name>instance-0000000e</name>
Apr 12 01:53:32 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:53:32 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:53:32 user nova-compute[82184]:   <metadata>
Apr 12 01:53:32 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:53:32 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:53:32 user nova-compute[82184]:       <nova:name>tempest-VolumesActionsTest-instance-1114639621</nova:name>
Apr 12 01:53:32 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:53:32</nova:creationTime>
Apr 12 01:53:32 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:53:32 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:53:32 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:53:32 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:53:32 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:53:32 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:53:32 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:53:32 user nova-compute[82184]:       <nova:owner>
Apr 12 01:53:32 user nova-compute[82184]:         <nova:user uuid="a92cd627a1c04cedacc4aa3e2398b960">tempest-VolumesActionsTest-621357222-project-member</nova:user>
Apr 12 01:53:32 user nova-compute[82184]:         <nova:project uuid="32e80d0c6d6f44c786b1053c0547de3b">tempest-VolumesActionsTest-621357222</nova:project>
Apr 12 01:53:32 user nova-compute[82184]:       </nova:owner>
Apr 12 01:53:32 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:53:32 user nova-compute[82184]:       <nova:ports>
Apr 12 01:53:32 user nova-compute[82184]:         <nova:port uuid="3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e">
Apr 12 01:53:32 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 01:53:32 user nova-compute[82184]:         </nova:port>
Apr 12 01:53:32 user nova-compute[82184]:       </nova:ports>
Apr 12 01:53:32 user nova-compute[82184]:     </nova:instance>
Apr 12 01:53:32 user nova-compute[82184]:   </metadata>
Apr 12 01:53:32 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:53:32 user nova-compute[82184]:     <system>
Apr 12 01:53:32 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:53:32 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:53:32 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:53:32 user nova-compute[82184]:       <entry name="serial">fd946144-5343-4788-b04d-ca1ed81afce9</entry>
Apr 12 01:53:32 user nova-compute[82184]:       <entry name="uuid">fd946144-5343-4788-b04d-ca1ed81afce9</entry>
Apr 12 01:53:32 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:53:32 user nova-compute[82184]:     </system>
Apr 12 01:53:32 user nova-compute[82184]:   </sysinfo>
Apr 12 01:53:32 user nova-compute[82184]:   <os>
Apr 12 01:53:32 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:53:32 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:53:32 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:53:32 user nova-compute[82184]:   </os>
Apr 12 01:53:32 user nova-compute[82184]:   <features>
Apr 12 01:53:32 user nova-compute[82184]:     <acpi/>
Apr 12 01:53:32 user nova-compute[82184]:     <apic/>
Apr 12 01:53:32 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:53:32 user nova-compute[82184]:   </features>
Apr 12 01:53:32 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:53:32 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:53:32 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:53:32 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:53:32 user nova-compute[82184]:   </clock>
Apr 12 01:53:32 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:53:32 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:53:32 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:53:32 user nova-compute[82184]:   </cpu>
Apr 12 01:53:32 user nova-compute[82184]:   <devices>
Apr 12 01:53:32 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:53:32 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:53:32 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk"/>
Apr 12 01:53:32 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:53:32 user nova-compute[82184]:     </disk>
Apr 12 01:53:32 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:53:32 user nova-compute[82184]:       <mac address="fa:16:3e:10:f9:ee"/>
Apr 12 01:53:32 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:53:32 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:53:32 user nova-compute[82184]:       <target dev="tap3aae11f1-3c"/>
Apr 12 01:53:32 user nova-compute[82184]:     </interface>
Apr 12 01:53:32 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:53:32 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/console.log" append="off"/>
Apr 12 01:53:32 user nova-compute[82184]:     </serial>
Apr 12 01:53:32 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:53:32 user nova-compute[82184]:     <video>
Apr 12 01:53:32 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:53:32 user nova-compute[82184]:     </video>
Apr 12 01:53:32 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:53:32 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:53:32 user nova-compute[82184]:     </rng>
Apr 12 01:53:32 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:53:32 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:53:32 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:53:32 user nova-compute[82184]:     </memballoon>
Apr 12 01:53:32 user nova-compute[82184]:   </devices>
Apr 12 01:53:32 user nova-compute[82184]: </domain>
Apr 12 01:53:32 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1114639621',display_name='tempest-VolumesActionsTest-instance-1114639621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1114639621',id=14,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32e80d0c6d6f44c786b1053c0547de3b',ramdisk_id='',reservation_id='r-uuohpjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-621357222',owner_user_name='tempest-VolumesActionsTest-621357222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:53:31Z,user_data=None,user_id='a92cd627a1c04cedacc4aa3e2398b960',uuid=fd946144-5343-4788-b04d-ca1ed81afce9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "address": "fa:16:3e:10:f9:ee", "network": {"id": "519f5539-952c-455f-aae3-420bb4c92b09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1460084896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "32e80d0c6d6f44c786b1053c0547de3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aae11f1-3c", "ovs_interfaceid": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Converting VIF {"id": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "address": "fa:16:3e:10:f9:ee", "network": {"id": "519f5539-952c-455f-aae3-420bb4c92b09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1460084896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "32e80d0c6d6f44c786b1053c0547de3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aae11f1-3c", "ovs_interfaceid": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:ee,bridge_name='br-int',has_traffic_filtering=True,id=3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e,network=Network(519f5539-952c-455f-aae3-420bb4c92b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aae11f1-3c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG os_vif [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:ee,bridge_name='br-int',has_traffic_filtering=True,id=3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e,network=Network(519f5539-952c-455f-aae3-420bb4c92b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aae11f1-3c') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3aae11f1-3c, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3aae11f1-3c, col_values=(('external_ids', {'iface-id': '3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:f9:ee', 'vm-uuid': 'fd946144-5343-4788-b04d-ca1ed81afce9'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "2f32ace1-1adc-4b75-a1cc-daac2e724846" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:32 user nova-compute[82184]: INFO nova.compute.manager [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Terminating instance
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:32 user nova-compute[82184]: INFO os_vif [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:ee,bridge_name='br-int',has_traffic_filtering=True,id=3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e,network=Network(519f5539-952c-455f-aae3-420bb4c92b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aae11f1-3c')
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Successfully updated port: 0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "refresh_cache-9fa9bdbe-ee75-425e-bed5-049fdf908d09" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquired lock "refresh_cache-9fa9bdbe-ee75-425e-bed5-049fdf908d09" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-ce83c779-17e5-49d0-a7ff-0b329c05e3d7 req-214fc884-ce5a-4f4e-824d-801535561e71 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Received event network-changed-0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-ce83c779-17e5-49d0-a7ff-0b329c05e3d7 req-214fc884-ce5a-4f4e-824d-801535561e71 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Refreshing instance network info cache due to event network-changed-0a900b27-d2bd-420d-a5cf-1df8fee01d93. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ce83c779-17e5-49d0-a7ff-0b329c05e3d7 req-214fc884-ce5a-4f4e-824d-801535561e71 service nova] Acquiring lock "refresh_cache-9fa9bdbe-ee75-425e-bed5-049fdf908d09" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] No VIF found with MAC fa:16:3e:10:f9:ee, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:53:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Updating instance_info_cache with network_info: [{"id": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "address": "fa:16:3e:0a:cf:b4", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a900b27-d2", "ovs_interfaceid": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Releasing lock "refresh_cache-9fa9bdbe-ee75-425e-bed5-049fdf908d09" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Instance network_info: |[{"id": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "address": "fa:16:3e:0a:cf:b4", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a900b27-d2", "ovs_interfaceid": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ce83c779-17e5-49d0-a7ff-0b329c05e3d7 req-214fc884-ce5a-4f4e-824d-801535561e71 service nova] Acquired lock "refresh_cache-9fa9bdbe-ee75-425e-bed5-049fdf908d09" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.network.neutron [req-ce83c779-17e5-49d0-a7ff-0b329c05e3d7 req-214fc884-ce5a-4f4e-824d-801535561e71 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Refreshing network info cache for port 0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Start _get_guest_xml network_info=[{"id": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "address": "fa:16:3e:0a:cf:b4", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a900b27-d2", "ovs_interfaceid": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:53:33 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:53:33 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1600919856',display_name='tempest-VolumesActionsTest-instance-1600919856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1600919856',id=15,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce361b6fa374bca8dc0a48a53ad54f9',ramdisk_id='',reservation_id='r-ah6iic14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-89585441',owner_user_name='tempest-VolumesActionsTest-89585441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:53:31Z,user_data=None,user_id='4d876b30b1724669a8d7e8bd543fa18c',uuid=9fa9bdbe-ee75-425e-bed5-049fdf908d09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "address": "fa:16:3e:0a:cf:b4", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a900b27-d2", "ovs_interfaceid": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converting VIF {"id": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "address": "fa:16:3e:0a:cf:b4", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a900b27-d2", "ovs_interfaceid": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cf:b4,bridge_name='br-int',has_traffic_filtering=True,id=0a900b27-d2bd-420d-a5cf-1df8fee01d93,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a900b27-d2') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fa9bdbe-ee75-425e-bed5-049fdf908d09 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:53:33 user nova-compute[82184]:   <uuid>9fa9bdbe-ee75-425e-bed5-049fdf908d09</uuid>
Apr 12 01:53:33 user nova-compute[82184]:   <name>instance-0000000f</name>
Apr 12 01:53:33 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:53:33 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:53:33 user nova-compute[82184]:   <metadata>
Apr 12 01:53:33 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:53:33 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:53:33 user nova-compute[82184]:       <nova:name>tempest-VolumesActionsTest-instance-1600919856</nova:name>
Apr 12 01:53:33 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:53:33</nova:creationTime>
Apr 12 01:53:33 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:53:33 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:53:33 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:53:33 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:53:33 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:53:33 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:53:33 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:53:33 user nova-compute[82184]:       <nova:owner>
Apr 12 01:53:33 user nova-compute[82184]:         <nova:user uuid="4d876b30b1724669a8d7e8bd543fa18c">tempest-VolumesActionsTest-89585441-project-member</nova:user>
Apr 12 01:53:33 user nova-compute[82184]:         <nova:project uuid="3ce361b6fa374bca8dc0a48a53ad54f9">tempest-VolumesActionsTest-89585441</nova:project>
Apr 12 01:53:33 user nova-compute[82184]:       </nova:owner>
Apr 12 01:53:33 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:53:33 user nova-compute[82184]:       <nova:ports>
Apr 12 01:53:33 user nova-compute[82184]:         <nova:port uuid="0a900b27-d2bd-420d-a5cf-1df8fee01d93">
Apr 12 01:53:33 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 01:53:33 user nova-compute[82184]:         </nova:port>
Apr 12 01:53:33 user nova-compute[82184]:       </nova:ports>
Apr 12 01:53:33 user nova-compute[82184]:     </nova:instance>
Apr 12 01:53:33 user nova-compute[82184]:   </metadata>
Apr 12 01:53:33 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:53:33 user nova-compute[82184]:     <system>
Apr 12 01:53:33 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:53:33 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:53:33 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:53:33 user nova-compute[82184]:       <entry name="serial">9fa9bdbe-ee75-425e-bed5-049fdf908d09</entry>
Apr 12 01:53:33 user nova-compute[82184]:       <entry name="uuid">9fa9bdbe-ee75-425e-bed5-049fdf908d09</entry>
Apr 12 01:53:33 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:53:33 user nova-compute[82184]:     </system>
Apr 12 01:53:33 user nova-compute[82184]:   </sysinfo>
Apr 12 01:53:33 user nova-compute[82184]:   <os>
Apr 12 01:53:33 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:53:33 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:53:33 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:53:33 user nova-compute[82184]:   </os>
Apr 12 01:53:33 user nova-compute[82184]:   <features>
Apr 12 01:53:33 user nova-compute[82184]:     <acpi/>
Apr 12 01:53:33 user nova-compute[82184]:     <apic/>
Apr 12 01:53:33 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:53:33 user nova-compute[82184]:   </features>
Apr 12 01:53:33 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:53:33 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:53:33 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:53:33 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:53:33 user nova-compute[82184]:   </clock>
Apr 12 01:53:33 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:53:33 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:53:33 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:53:33 user nova-compute[82184]:   </cpu>
Apr 12 01:53:33 user nova-compute[82184]:   <devices>
Apr 12 01:53:33 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:53:33 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:53:33 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk"/>
Apr 12 01:53:33 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:53:33 user nova-compute[82184]:     </disk>
Apr 12 01:53:33 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:53:33 user nova-compute[82184]:       <mac address="fa:16:3e:0a:cf:b4"/>
Apr 12 01:53:33 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:53:33 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:53:33 user nova-compute[82184]:       <target dev="tap0a900b27-d2"/>
Apr 12 01:53:33 user nova-compute[82184]:     </interface>
Apr 12 01:53:33 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:53:33 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/console.log" append="off"/>
Apr 12 01:53:33 user nova-compute[82184]:     </serial>
Apr 12 01:53:33 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:53:33 user nova-compute[82184]:     <video>
Apr 12 01:53:33 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:53:33 user nova-compute[82184]:     </video>
Apr 12 01:53:33 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:53:33 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:53:33 user nova-compute[82184]:     </rng>
Apr 12 01:53:33 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:53:33 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:53:33 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:53:33 user nova-compute[82184]:     </memballoon>
Apr 12 01:53:33 user nova-compute[82184]:   </devices>
Apr 12 01:53:33 user nova-compute[82184]: </domain>
Apr 12 01:53:33 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1600919856',display_name='tempest-VolumesActionsTest-instance-1600919856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1600919856',id=15,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce361b6fa374bca8dc0a48a53ad54f9',ramdisk_id='',reservation_id='r-ah6iic14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-89585441',owner_user_name='tempest-VolumesActionsTest-89585441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:53:31Z,user_data=None,user_id='4d876b30b1724669a8d7e8bd543fa18c',uuid=9fa9bdbe-ee75-425e-bed5-049fdf908d09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "address": "fa:16:3e:0a:cf:b4", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a900b27-d2", "ovs_interfaceid": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converting VIF {"id": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "address": "fa:16:3e:0a:cf:b4", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a900b27-d2", "ovs_interfaceid": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cf:b4,bridge_name='br-int',has_traffic_filtering=True,id=0a900b27-d2bd-420d-a5cf-1df8fee01d93,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a900b27-d2') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG os_vif [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cf:b4,bridge_name='br-int',has_traffic_filtering=True,id=0a900b27-d2bd-420d-a5cf-1df8fee01d93,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a900b27-d2') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a900b27-d2, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a900b27-d2, col_values=(('external_ids', {'iface-id': '0a900b27-d2bd-420d-a5cf-1df8fee01d93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:cf:b4', 'vm-uuid': '9fa9bdbe-ee75-425e-bed5-049fdf908d09'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:33 user nova-compute[82184]: INFO os_vif [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cf:b4,bridge_name='br-int',has_traffic_filtering=True,id=0a900b27-d2bd-420d-a5cf-1df8fee01d93,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a900b27-d2')
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] No VIF found with MAC fa:16:3e:0a:cf:b4, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.network.neutron [req-f73998a4-da28-4f23-9198-3727efbed563 req-ed96152f-0b36-4a40-a735-ce2984d11585 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Updated VIF entry in instance network info cache for port 3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.network.neutron [req-f73998a4-da28-4f23-9198-3727efbed563 req-ed96152f-0b36-4a40-a735-ce2984d11585 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Updating instance_info_cache with network_info: [{"id": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "address": "fa:16:3e:10:f9:ee", "network": {"id": "519f5539-952c-455f-aae3-420bb4c92b09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1460084896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "32e80d0c6d6f44c786b1053c0547de3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aae11f1-3c", "ovs_interfaceid": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f73998a4-da28-4f23-9198-3727efbed563 req-ed96152f-0b36-4a40-a735-ce2984d11585 service nova] Releasing lock "refresh_cache-fd946144-5343-4788-b04d-ca1ed81afce9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.network.neutron [req-ce83c779-17e5-49d0-a7ff-0b329c05e3d7 req-214fc884-ce5a-4f4e-824d-801535561e71 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Updated VIF entry in instance network info cache for port 0a900b27-d2bd-420d-a5cf-1df8fee01d93. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG nova.network.neutron [req-ce83c779-17e5-49d0-a7ff-0b329c05e3d7 req-214fc884-ce5a-4f4e-824d-801535561e71 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Updating instance_info_cache with network_info: [{"id": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "address": "fa:16:3e:0a:cf:b4", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a900b27-d2", "ovs_interfaceid": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ce83c779-17e5-49d0-a7ff-0b329c05e3d7 req-214fc884-ce5a-4f4e-824d-801535561e71 service nova] Releasing lock "refresh_cache-9fa9bdbe-ee75-425e-bed5-049fdf908d09" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Received event network-vif-unplugged-98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] Acquiring lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] No waiting events found dispatching network-vif-unplugged-98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Received event network-vif-unplugged-98ce60a7-28d6-42db-8002-f433bd77175e for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Received event network-vif-plugged-98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] Acquiring lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] No waiting events found dispatching network-vif-plugged-98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:34 user nova-compute[82184]: WARNING nova.compute.manager [req-61275789-2430-48bb-bd39-086a4dd7545f req-c6797ffb-689a-4da1-ba64-661fcfdaba30 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Received unexpected event network-vif-plugged-98ce60a7-28d6-42db-8002-f433bd77175e for instance with vm_state active and task_state deleting.
Apr 12 01:53:34 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Instance destroyed successfully.
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.objects.instance [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lazy-loading 'resources' on Instance uuid 2f32ace1-1adc-4b75-a1cc-daac2e724846 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1705395768',display_name='tempest-ServersNegativeTestJSON-server-1705395768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1705395768',id=12,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='021f9aee2b7849ef8fcd67d6d6522d27',ramdisk_id='',reservation_id='r-wulg0dap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-292036935',owner_user_name='tempest-ServersNegativeTestJSON-292036935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:54Z,user_data=None,user_id='728c534ef1f54c50ad2b619b44c3b9c7',uuid=2f32ace1-1adc-4b75-a1cc-daac2e724846,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98ce60a7-28d6-42db-8002-f433bd77175e", "address": "fa:16:3e:7f:4a:00", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ce60a7-28", "ovs_interfaceid": "98ce60a7-28d6-42db-8002-f433bd77175e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converting VIF {"id": "98ce60a7-28d6-42db-8002-f433bd77175e", "address": "fa:16:3e:7f:4a:00", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98ce60a7-28", "ovs_interfaceid": "98ce60a7-28d6-42db-8002-f433bd77175e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:4a:00,bridge_name='br-int',has_traffic_filtering=True,id=98ce60a7-28d6-42db-8002-f433bd77175e,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ce60a7-28') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG os_vif [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:4a:00,bridge_name='br-int',has_traffic_filtering=True,id=98ce60a7-28d6-42db-8002-f433bd77175e,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ce60a7-28') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98ce60a7-28, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:34 user nova-compute[82184]: INFO os_vif [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:4a:00,bridge_name='br-int',has_traffic_filtering=True,id=98ce60a7-28d6-42db-8002-f433bd77175e,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98ce60a7-28')
Apr 12 01:53:34 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Deleting instance files /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846_del
Apr 12 01:53:34 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Deletion of /opt/stack/data/nova/instances/2f32ace1-1adc-4b75-a1cc-daac2e724846_del complete
Apr 12 01:53:34 user nova-compute[82184]: INFO nova.compute.manager [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Took 1.90 seconds to destroy the instance on the hypervisor.
Apr 12 01:53:34 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG nova.objects.instance [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'flavor' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:35 user nova-compute[82184]: INFO nova.compute.manager [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attaching volume 333bfdb2-c5a0-443a-bcc1-c203e669c896 to /dev/vdb
Apr 12 01:53:35 user nova-compute[82184]: DEBUG os_brick.utils [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:35 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Took 0.46 seconds to deallocate network for instance.
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a115876a-43dd-4cfc-9c0d-247769ee6c4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-95bb446d-f996-4154-97ee-b3d23d60e4e6 req-bfd79cf5-ed01-4ce5-a65e-73770e9094c4 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Received event network-vif-deleted-98ce60a7-28d6-42db-8002-f433bd77175e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:35 user nova-compute[82184]: INFO nova.compute.manager [req-95bb446d-f996-4154-97ee-b3d23d60e4e6 req-bfd79cf5-ed01-4ce5-a65e-73770e9094c4 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Neutron deleted interface 98ce60a7-28d6-42db-8002-f433bd77175e; detaching it from the instance and deleting it from the info cache
Apr 12 01:53:35 user nova-compute[82184]: DEBUG nova.network.neutron [req-95bb446d-f996-4154-97ee-b3d23d60e4e6 req-bfd79cf5-ed01-4ce5-a65e-73770e9094c4 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19d3076-34a8-4332-87d1-74eb9176a901]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-95bb446d-f996-4154-97ee-b3d23d60e4e6 req-bfd79cf5-ed01-4ce5-a65e-73770e9094c4 service nova] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Detach interface failed, port_id=98ce60a7-28d6-42db-8002-f433bd77175e, reason: Instance 2f32ace1-1adc-4b75-a1cc-daac2e724846 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59da953-4439-44d9-bee4-a6e4137cc327]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83fefab-830b-46de-9972-9498efb447a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:53:35 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a60d7ea-e54a-41ff-8402-b1e710c11ed5]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG os_brick.utils [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating existing volume attachment record: 24b57392-9ed5-4150-af58-e78cfcc29dff {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:35 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Deleted allocations for instance 2f32ace1-1adc-4b75-a1cc-daac2e724846
Apr 12 01:53:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dac03d22-b162-4dc7-a806-e52d32874296 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "2f32ace1-1adc-4b75-a1cc-daac2e724846" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.996s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-90fbdc0c-10db-483e-a13d-6967ee62940b req-b10ae652-824a-419e-b8db-df14fcfe655d service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Received event network-vif-plugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-90fbdc0c-10db-483e-a13d-6967ee62940b req-b10ae652-824a-419e-b8db-df14fcfe655d service nova] Acquiring lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-90fbdc0c-10db-483e-a13d-6967ee62940b req-b10ae652-824a-419e-b8db-df14fcfe655d service nova] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-90fbdc0c-10db-483e-a13d-6967ee62940b req-b10ae652-824a-419e-b8db-df14fcfe655d service nova] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-90fbdc0c-10db-483e-a13d-6967ee62940b req-b10ae652-824a-419e-b8db-df14fcfe655d service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] No waiting events found dispatching network-vif-plugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:35 user nova-compute[82184]: WARNING nova.compute.manager [req-90fbdc0c-10db-483e-a13d-6967ee62940b req-b10ae652-824a-419e-b8db-df14fcfe655d service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Received unexpected event network-vif-plugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 for instance with vm_state building and task_state spawning.
Apr 12 01:53:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:36 user nova-compute[82184]: INFO nova.compute.manager [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Terminating instance
Apr 12 01:53:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-40cd04a1-e72e-4710-a98b-12b5ed7da919 req-878ce747-38aa-4f37-aa20-ca98a7d97e4a service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Received event network-vif-plugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-40cd04a1-e72e-4710-a98b-12b5ed7da919 req-878ce747-38aa-4f37-aa20-ca98a7d97e4a service nova] Acquiring lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-40cd04a1-e72e-4710-a98b-12b5ed7da919 req-878ce747-38aa-4f37-aa20-ca98a7d97e4a service nova] Lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-40cd04a1-e72e-4710-a98b-12b5ed7da919 req-878ce747-38aa-4f37-aa20-ca98a7d97e4a service nova] Lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-40cd04a1-e72e-4710-a98b-12b5ed7da919 req-878ce747-38aa-4f37-aa20-ca98a7d97e4a service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] No waiting events found dispatching network-vif-plugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:36 user nova-compute[82184]: WARNING nova.compute.manager [req-40cd04a1-e72e-4710-a98b-12b5ed7da919 req-878ce747-38aa-4f37-aa20-ca98a7d97e4a service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Received unexpected event network-vif-plugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e for instance with vm_state building and task_state spawning.
Apr 12 01:53:36 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Instance destroyed successfully.
Apr 12 01:53:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lazy-loading 'resources' on Instance uuid 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:50:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-74378898',display_name='tempest-TestVolumeSwap-server-74378898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-74378898',id=9,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKW4t6M942/LHh6daB7qePEWtiWAJ7b1N9u1/DPWtDalmVzTtTt8SSDAJEDRAeJhrXKOzi8MtjgYWJTbhnxcGIllhlDsuyE7LR5HijyXxbU86EQHerBjvbSSrdtGqPatAQ==',key_name='tempest-keypair-2091713473',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a1f516270354a82995f75c4c149dad2',ramdisk_id='',reservation_id='r-jblj099o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-706858033',owner_user_name='tempest-TestVolumeSwap-706858033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='592f78cbcf7046e68bcf6c88e039a9be',uuid=34cbdbd9-16ac-4cbc-be28-c88b7c23de02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Converting VIF {"id": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "address": "fa:16:3e:ea:a4:9a", "network": {"id": "409e7f9e-7aa8-44e0-8d4f-6582d339e7c6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-695357297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1f516270354a82995f75c4c149dad2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afbc2d8-20", "ovs_interfaceid": "0afbc2d8-20bd-4f40-b45b-53bad28276d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=0afbc2d8-20bd-4f40-b45b-53bad28276d4,network=Network(409e7f9e-7aa8-44e0-8d4f-6582d339e7c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afbc2d8-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG os_vif [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=0afbc2d8-20bd-4f40-b45b-53bad28276d4,network=Network(409e7f9e-7aa8-44e0-8d4f-6582d339e7c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afbc2d8-20') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0afbc2d8-20, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:37 user nova-compute[82184]: INFO os_vif [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=0afbc2d8-20bd-4f40-b45b-53bad28276d4,network=Network(409e7f9e-7aa8-44e0-8d4f-6582d339e7c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afbc2d8-20')
Apr 12 01:53:37 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Deleting instance files /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02_del
Apr 12 01:53:37 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Deletion of /opt/stack/data/nova/instances/34cbdbd9-16ac-4cbc-be28-c88b7c23de02_del complete
Apr 12 01:53:37 user nova-compute[82184]: INFO nova.compute.manager [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 12 01:53:37 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:53:37 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:53:37 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:53:37 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:37 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Took 0.87 seconds to deallocate network for instance.
Apr 12 01:53:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-46a1f2e3-d5f2-41fa-a00a-ae1974e49dab req-d35856d2-6d6b-49cd-84c9-ba8269c65a5b service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received event network-vif-deleted-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-94e3cc2f-7b98-44db-9302-f4c8dcb643fa req-a44aced3-3fab-40b2-b1be-1bf9ac55fd77 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Received event network-vif-plugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-94e3cc2f-7b98-44db-9302-f4c8dcb643fa req-a44aced3-3fab-40b2-b1be-1bf9ac55fd77 service nova] Acquiring lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-94e3cc2f-7b98-44db-9302-f4c8dcb643fa req-a44aced3-3fab-40b2-b1be-1bf9ac55fd77 service nova] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-94e3cc2f-7b98-44db-9302-f4c8dcb643fa req-a44aced3-3fab-40b2-b1be-1bf9ac55fd77 service nova] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-94e3cc2f-7b98-44db-9302-f4c8dcb643fa req-a44aced3-3fab-40b2-b1be-1bf9ac55fd77 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] No waiting events found dispatching network-vif-plugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:38 user nova-compute[82184]: WARNING nova.compute.manager [req-94e3cc2f-7b98-44db-9302-f4c8dcb643fa req-a44aced3-3fab-40b2-b1be-1bf9ac55fd77 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Received unexpected event network-vif-plugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 for instance with vm_state building and task_state spawning.
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:38 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Deleted allocations for instance 34cbdbd9-16ac-4cbc-be28-c88b7c23de02
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Received event network-vif-plugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] Acquiring lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] Lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] Lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] No waiting events found dispatching network-vif-plugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:38 user nova-compute[82184]: WARNING nova.compute.manager [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Received unexpected event network-vif-plugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e for instance with vm_state building and task_state spawning.
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received event network-vif-unplugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] No waiting events found dispatching network-vif-unplugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:38 user nova-compute[82184]: WARNING nova.compute.manager [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received unexpected event network-vif-unplugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 for instance with vm_state deleted and task_state None.
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received event network-vif-plugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] Acquiring lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] No waiting events found dispatching network-vif-plugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:38 user nova-compute[82184]: WARNING nova.compute.manager [req-4b96035c-10a2-40fc-993f-c26e0ec71094 req-61ad34e4-0bdf-4651-bcec-6865f842da5f service nova] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Received unexpected event network-vif-plugged-0afbc2d8-20bd-4f40-b45b-53bad28276d4 for instance with vm_state deleted and task_state None.
Apr 12 01:53:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-740da9f8-6612-4dff-bb8a-b902ef2019f9 tempest-TestVolumeSwap-706858033 tempest-TestVolumeSwap-706858033-project-member] Lock "34cbdbd9-16ac-4cbc-be28-c88b7c23de02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.565s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264418.8697753, fd946144-5343-4788-b04d-ca1ed81afce9 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:38 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] VM Resumed (Lifecycle Event)
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:53:38 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Instance spawned successfully.
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:53:38 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Instance spawned successfully.
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:53:38 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264418.873335, fd946144-5343-4788-b04d-ca1ed81afce9 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:38 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] VM Started (Lifecycle Event)
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:53:38 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:53:38 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264418.9280717, 9fa9bdbe-ee75-425e-bed5-049fdf908d09 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:38 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] VM Resumed (Lifecycle Event)
Apr 12 01:53:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:53:39 user nova-compute[82184]: INFO nova.compute.manager [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Took 7.53 seconds to spawn the instance on the hypervisor.
Apr 12 01:53:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:39 user nova-compute[82184]: INFO nova.compute.manager [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Took 8.25 seconds to spawn the instance on the hypervisor.
Apr 12 01:53:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:39 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:53:39 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264418.9291418, 9fa9bdbe-ee75-425e-bed5-049fdf908d09 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:39 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] VM Started (Lifecycle Event)
Apr 12 01:53:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:53:39 user nova-compute[82184]: INFO nova.compute.manager [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Took 9.03 seconds to build instance.
Apr 12 01:53:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-227f5355-66a2-4a6a-b20b-d718d6e765a8 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "fd946144-5343-4788-b04d-ca1ed81afce9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.187s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:39 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:53:39 user nova-compute[82184]: INFO nova.compute.manager [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Took 8.63 seconds to build instance.
Apr 12 01:53:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b3b83a6e-f3ab-4df6-8f73-c5ce1feea565 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.733s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHlJjRpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:53:40 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:53:40 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:53:40 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[09870aa9-80f1-4815-8904-5c7321f703f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:53:40 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dc48aa-e075-4443-899e-3df7548ed029]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896] added
Apr 12 01:53:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f372ef7f-79f9-4946-bb4e-d16f9f9d12a1]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379fc8a-078a-4225-99a9-befe4501e64a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hHlJjRpX {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hHlJjRpX" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f31169-db61-4670-bb56-90b2e75023aa]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hHlJjRpX'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1fb36d-23b7-41a0-9057-0146936c8bd7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76df1bee-0611-42fb-9b39-3e1ab9b8b0ed]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37d0dad-d455-438a-b87d-5a90d9ab6ce2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260]
Apr 12 01:53:40 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260] successful.
Apr 12 01:53:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b564969a-003e-44a4-bee8-7bba47b1b0e7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0496a9-3507-4b50-b761-c63b8ea1e41e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)
Apr 12 01:53:40 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)
Apr 12 01:53:40 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[03466b6e-d29b-4ed8-ac99-d526104acad7]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHlJjRpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:53:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23934383535643862', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934383535643862', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG nova.objects.instance [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'flavor' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:53:41 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:53:41 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 01:53:41 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:53:41 user nova-compute[82184]:   <serial>333bfdb2-c5a0-443a-bcc1-c203e669c896</serial>
Apr 12 01:53:41 user nova-compute[82184]: </disk>
Apr 12 01:53:41 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:53:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No VIF found with MAC fa:16:3e:f9:ed:df, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-24d1b12e-54b8-48df-9e91-762770098c10 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.271s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:43 user nova-compute[82184]: INFO nova.compute.manager [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Rebuilding instance
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'trusted_certs' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'pci_requests' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'pci_devices' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'resources' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'migration_context' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG nova.objects.instance [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82184) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-e12a91aa-07ff-4604-84fd-1d56e7162a15 req-3d6330f0-8673-49b8-a0d0-3a439a8537e2 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e12a91aa-07ff-4604-84fd-1d56e7162a15 req-3d6330f0-8673-49b8-a0d0-3a439a8537e2 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e12a91aa-07ff-4604-84fd-1d56e7162a15 req-3d6330f0-8673-49b8-a0d0-3a439a8537e2 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e12a91aa-07ff-4604-84fd-1d56e7162a15 req-3d6330f0-8673-49b8-a0d0-3a439a8537e2 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-e12a91aa-07ff-4604-84fd-1d56e7162a15 req-3d6330f0-8673-49b8-a0d0-3a439a8537e2 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:44 user nova-compute[82184]: WARNING nova.compute.manager [req-e12a91aa-07ff-4604-84fd-1d56e7162a15 req-3d6330f0-8673-49b8-a0d0-3a439a8537e2 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state active and task_state rebuilding.
Apr 12 01:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:44 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance destroyed successfully.
Apr 12 01:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:44 user nova-compute[82184]: INFO nova.compute.manager [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Detaching volume 333bfdb2-c5a0-443a-bcc1-c203e669c896
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:53:45 user nova-compute[82184]: INFO nova.virt.block_device [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attempting to driver detach volume 333bfdb2-c5a0-443a-bcc1-c203e669c896 from mountpoint /dev/vdb
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Attempting to detach device vdb from instance c712f2db-72cb-4136-a719-56057d82fff6 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:53:45 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:53:45 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 01:53:45 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:53:45 user nova-compute[82184]:   <serial>333bfdb2-c5a0-443a-bcc1-c203e669c896</serial>
Apr 12 01:53:45 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:53:45 user nova-compute[82184]: </disk>
Apr 12 01:53:45 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:53:45 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully detached device vdb from instance c712f2db-72cb-4136-a719-56057d82fff6 from the persistent domain config.
Apr 12 01:53:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHlJjRpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:53:45 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7511151c-541e-4703-a91d-b089b13a181c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:53:45 user nova-compute[82184]: No targets found.
Apr 12 01:53:45 user nova-compute[82184]: iSNS:
Apr 12 01:53:45 user nova-compute[82184]: No targets found.
Apr 12 01:53:45 user nova-compute[82184]: STATIC:
Apr 12 01:53:45 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:53:45 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:53:45 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:53:45 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896
Apr 12 01:53:45 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:53:45 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:53:45 user nova-compute[82184]: FIRMWARE:
Apr 12 01:53:45 user nova-compute[82184]: No targets found.
Apr 12 01:53:45 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:53:45 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:53:45 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef7330e-b34c-4024-92d4-4748868a7912]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9822ef35-a8f4-4042-8331-8753c03b8527]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)
Apr 12 01:53:45 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:45 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)
Apr 12 01:53:45 user nova-compute[82184]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:45 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a85ee170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c8aa0b-60d5-4f5a-aa3b-c07a6fdae71a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2d893a-a6e1-4e49-9d9d-5f40519470b0]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[25771d67-c1d5-4e85-8e9d-8e9399a2fba1]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0ceb57-72f1-4d36-8da2-7cc872623be1]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eac2025-a631-4961-828c-16fe12dba908]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8a4a56-fbe0-475c-9be1-11b1c08ac02f]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260]
Apr 12 01:53:45 user nova-compute[82184]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260] successful.
Apr 12 01:53:45 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[215131d5-a1bb-4269-b4fe-1910a632d7b7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== disconnect_volume: return (361ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-e6808bf9-74f5-491b-94c3-7b975c12a615 req-15cec2e0-a05c-4ddf-8125-9d6ae3532c90 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e6808bf9-74f5-491b-94c3-7b975c12a615 req-15cec2e0-a05c-4ddf-8125-9d6ae3532c90 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e6808bf9-74f5-491b-94c3-7b975c12a615 req-15cec2e0-a05c-4ddf-8125-9d6ae3532c90 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e6808bf9-74f5-491b-94c3-7b975c12a615 req-15cec2e0-a05c-4ddf-8125-9d6ae3532c90 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-e6808bf9-74f5-491b-94c3-7b975c12a615 req-15cec2e0-a05c-4ddf-8125-9d6ae3532c90 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:46 user nova-compute[82184]: WARNING nova.compute.manager [req-e6808bf9-74f5-491b-94c3-7b975c12a615 req-15cec2e0-a05c-4ddf-8125-9d6ae3532c90 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state active and task_state rebuilding.
Apr 12 01:53:46 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:53:46 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=7964MB free_disk=26.588485717773438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:46 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance destroyed successfully.
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-1476053452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_vif [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap365b7a91-79, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:46 user nova-compute[82184]: INFO os_vif [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79')
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHlJjRpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:53:46 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfefe04c-0cef-405e-bebf-335da2277ee9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:53:46 user nova-compute[82184]: No targets found.
Apr 12 01:53:46 user nova-compute[82184]: iSNS:
Apr 12 01:53:46 user nova-compute[82184]: No targets found.
Apr 12 01:53:46 user nova-compute[82184]: STATIC:
Apr 12 01:53:46 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:53:46 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:53:46 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:53:46 user nova-compute[82184]: FIRMWARE:
Apr 12 01:53:46 user nova-compute[82184]: No targets found.
Apr 12 01:53:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:53:46 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:53:46 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[486cf3d5-9cf3-41b4-94d7-46436c0efdf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cb89325c-680a-4413-8e94-4eddfaa79c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2acd2ee1-172a-4984-85ed-52a8e78aafb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fd946144-5343-4788-b04d-ca1ed81afce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 9fa9bdbe-ee75-425e-bed5-049fdf908d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c0363e-413f-4f50-b111-f0a845e698f1]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a85cda20>, {}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Disconnecting from: [] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.096s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== disconnect_volume: return (99ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:53:46 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Deleting instance files /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6_del
Apr 12 01:53:46 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Deletion of /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6_del complete
Apr 12 01:53:46 user nova-compute[82184]: INFO nova.virt.block_device [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Booting with volume 333bfdb2-c5a0-443a-bcc1-c203e669c896 at /dev/vdb
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.utils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[12452b99-3680-41b7-ae83-fa38457e11a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[985502ab-821d-44ba-b0cb-7a4a690c8ec8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6f5431-b1d8-4ed8-9472-08c2c9bc3c42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b12476f-7dd7-4978-9a06-cc631be6d679]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:53:46 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:53:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c64e91c-659b-40f5-9527-ac537d522d0c]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG os_brick.utils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating existing volume attachment record: a9bb3ab2-4980-46ab-b6ba-aebb04b5b872 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:53:46 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:53:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:53:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Updating instance_info_cache with network_info: [{"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:53:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:53:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:53:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquired lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:53:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:53:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'info_cache' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:49 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264414.5117502, 2f32ace1-1adc-4b75-a1cc-daac2e724846 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:49 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] VM Stopped (Lifecycle Event)
Apr 12 01:53:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1943d723-924e-459e-9638-9eab889e6746 None None] [instance: 2f32ace1-1adc-4b75-a1cc-daac2e724846] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updating instance_info_cache with network_info: [{"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Releasing lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:53:50 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance destroyed successfully.
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.objects.instance [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'resources' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-682748151',display_name='tempest-AttachVolumeTestJSON-server-682748151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-682748151',id=6,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2NTbVfrYVAmPq/WSiXNxhw73D4U473knUSj3S2SzGG67zJUMcYD7NdTMJnRymKmrJWRxrjStG5itGjTKaX5Cd+wZw4hLfWVikFnVEIrbrRCuVHjjCnBxwGGHScYXLHw==',key_name='tempest-keypair-663896141',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-n3kypybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=cb89325c-680a-4413-8e94-4eddfaa79c6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_vif [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec368fc5-6d, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:50 user nova-compute[82184]: INFO os_vif [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d')
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWTrRDKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:53:50 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca8610e-158d-4972-9eef-ba8eb3039051]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:53:50 user nova-compute[82184]: No targets found.
Apr 12 01:53:50 user nova-compute[82184]: iSNS:
Apr 12 01:53:50 user nova-compute[82184]: No targets found.
Apr 12 01:53:50 user nova-compute[82184]: STATIC:
Apr 12 01:53:50 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:53:50 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:53:50 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:53:50 user nova-compute[82184]: FIRMWARE:
Apr 12 01:53:50 user nova-compute[82184]: No targets found.
Apr 12 01:53:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:53:50 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:53:50 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dc8135-f27b-4f28-989e-adf74b6332c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b212ff-25dc-43c4-b256-2456eb27aab5]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a87a6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b'): ({'sdi'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Removing single pathed devices sdi {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fba26c6-0f76-409a-89d7-15957836d01f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa2ad4-aabc-48d2-981e-8593c039a019]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flushing IO for device /dev/sdi {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e543b2-598e-449b-980d-5546fe1f8ada]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.032s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8e1906-eb7d-4262-8a9e-0baf7e2c31b7]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] SCSI volumes sdi have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e470eaa0-ef91-4924-906b-36f5f5b0827b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc3684c-4035-4501-918f-a24abed95348]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260]
Apr 12 01:53:50 user nova-compute[82184]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260] successful.
Apr 12 01:53:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0a4b1c-dda7-40d2-a62d-9b6f50628841]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== disconnect_volume: return (310ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Start _get_guest_xml network_info=[{"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': 'b23c2333-9f0a-46dc-8892-286620eddc00', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWTrRDKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'cb89325c-680a-4413-8e94-4eddfaa79c6b', 'attached_at': '', 'detached_at': '', 'volume_id': '52725f14-a644-4019-b7c6-9547d83cfb1b', 'serial': '52725f14-a644-4019-b7c6-9547d83cfb1b'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.objects.instance [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'numa_topology' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:50 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:53:50 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.objects.instance [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'vcpu_model' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWTrRDKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:53:50 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:53:50 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:53:50 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260" returned: 21 in 0.038s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af07dd0-9e2e-4998-8cb5-ea9aa48a590b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:53:50 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2e60f9-a5eb-4c75-aa3e-e5444d69de4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b] added
Apr 12 01:53:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[baadf2a7-0559-4d0b-8505-fa9c3fedb6a3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a8f74-5c50-426b-8b9c-d1ac874ade95]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWTrRDKA {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWTrRDKA" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b0c3cc-cf64-476c-86a6-0052871dd4eb]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWTrRDKA'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6164ab34-4064-40a0-b949-801f5ccd31dc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bf3712-0d35-44cc-af4c-fed690c4a199]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:53:50 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:53:50 user nova-compute[82184]:  {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:53:50 user nova-compute[82184]: WARNING os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 01:53:50 user nova-compute[82184]: 
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a32ee87-fd30-4f2c-804b-a5f0c4ee430e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260]
Apr 12 01:53:50 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260] successful.
Apr 12 01:53:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[304f0e28-d148-4765-9445-0141867f88c1]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c23eeb1-df02-4c17-a732-43d2f72d7de6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5c9b6c-9644-450b-afc7-baa2f5729b0d]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWTrRDKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:53:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:53:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Creating image(s)
Apr 12 01:53:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264416.9323878, 34cbdbd9-16ac-4cbc-be28-c88b7c23de02 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:51 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] VM Stopped (Lifecycle Event)
Apr 12 01:53:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26235653533653762', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:53:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235653533653762', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-682748151',display_name='tempest-AttachVolumeTestJSON-server-682748151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-682748151',id=6,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2NTbVfrYVAmPq/WSiXNxhw73D4U473knUSj3S2SzGG67zJUMcYD7NdTMJnRymKmrJWRxrjStG5itGjTKaX5Cd+wZw4hLfWVikFnVEIrbrRCuVHjjCnBxwGGHScYXLHw==',key_name='tempest-keypair-663896141',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-n3kypybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=cb89325c-680a-4413-8e94-4eddfaa79c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.objects.instance [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'pci_devices' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-98255b49-e2ba-41f6-8c01-8c109f0b5b2d None None] [instance: 34cbdbd9-16ac-4cbc-be28-c88b7c23de02] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:53:52 user nova-compute[82184]:   <uuid>cb89325c-680a-4413-8e94-4eddfaa79c6b</uuid>
Apr 12 01:53:52 user nova-compute[82184]:   <name>instance-00000006</name>
Apr 12 01:53:52 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:53:52 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:53:52 user nova-compute[82184]:   <metadata>
Apr 12 01:53:52 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:53:52 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:53:52 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeTestJSON-server-682748151</nova:name>
Apr 12 01:53:52 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:53:50</nova:creationTime>
Apr 12 01:53:52 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:53:52 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:53:52 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:53:52 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:53:52 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:53:52 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:53:52 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:53:52 user nova-compute[82184]:       <nova:owner>
Apr 12 01:53:52 user nova-compute[82184]:         <nova:user uuid="d2ca4855c3e9461cb27c88469086d7d8">tempest-AttachVolumeTestJSON-913560355-project-member</nova:user>
Apr 12 01:53:52 user nova-compute[82184]:         <nova:project uuid="c34bd636a2a54b249dca9ce9027ebf4b">tempest-AttachVolumeTestJSON-913560355</nova:project>
Apr 12 01:53:52 user nova-compute[82184]:       </nova:owner>
Apr 12 01:53:52 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:53:52 user nova-compute[82184]:       <nova:ports>
Apr 12 01:53:52 user nova-compute[82184]:         <nova:port uuid="ec368fc5-6d05-4bab-8460-cf9f1e024195">
Apr 12 01:53:52 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 01:53:52 user nova-compute[82184]:         </nova:port>
Apr 12 01:53:52 user nova-compute[82184]:       </nova:ports>
Apr 12 01:53:52 user nova-compute[82184]:     </nova:instance>
Apr 12 01:53:52 user nova-compute[82184]:   </metadata>
Apr 12 01:53:52 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:53:52 user nova-compute[82184]:     <system>
Apr 12 01:53:52 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:53:52 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:53:52 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:53:52 user nova-compute[82184]:       <entry name="serial">cb89325c-680a-4413-8e94-4eddfaa79c6b</entry>
Apr 12 01:53:52 user nova-compute[82184]:       <entry name="uuid">cb89325c-680a-4413-8e94-4eddfaa79c6b</entry>
Apr 12 01:53:52 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:53:52 user nova-compute[82184]:     </system>
Apr 12 01:53:52 user nova-compute[82184]:   </sysinfo>
Apr 12 01:53:52 user nova-compute[82184]:   <os>
Apr 12 01:53:52 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:53:52 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:53:52 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:53:52 user nova-compute[82184]:   </os>
Apr 12 01:53:52 user nova-compute[82184]:   <features>
Apr 12 01:53:52 user nova-compute[82184]:     <acpi/>
Apr 12 01:53:52 user nova-compute[82184]:     <apic/>
Apr 12 01:53:52 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:53:52 user nova-compute[82184]:   </features>
Apr 12 01:53:52 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:53:52 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:53:52 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:53:52 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:53:52 user nova-compute[82184]:   </clock>
Apr 12 01:53:52 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:53:52 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:53:52 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:53:52 user nova-compute[82184]:   </cpu>
Apr 12 01:53:52 user nova-compute[82184]:   <devices>
Apr 12 01:53:52 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:53:52 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:53:52 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk"/>
Apr 12 01:53:52 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:53:52 user nova-compute[82184]:     </disk>
Apr 12 01:53:52 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:53:52 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:53:52 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 01:53:52 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 01:53:52 user nova-compute[82184]:       <serial>52725f14-a644-4019-b7c6-9547d83cfb1b</serial>
Apr 12 01:53:52 user nova-compute[82184]:     </disk>
Apr 12 01:53:52 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:53:52 user nova-compute[82184]:       <mac address="fa:16:3e:9d:cb:06"/>
Apr 12 01:53:52 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:53:52 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:53:52 user nova-compute[82184]:       <target dev="tapec368fc5-6d"/>
Apr 12 01:53:52 user nova-compute[82184]:     </interface>
Apr 12 01:53:52 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:53:52 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/console.log" append="off"/>
Apr 12 01:53:52 user nova-compute[82184]:     </serial>
Apr 12 01:53:52 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:53:52 user nova-compute[82184]:     <video>
Apr 12 01:53:52 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:53:52 user nova-compute[82184]:     </video>
Apr 12 01:53:52 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:53:52 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:53:52 user nova-compute[82184]:     </rng>
Apr 12 01:53:52 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:53:52 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:53:52 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:53:52 user nova-compute[82184]:     </memballoon>
Apr 12 01:53:52 user nova-compute[82184]:   </devices>
Apr 12 01:53:52 user nova-compute[82184]: </domain>
Apr 12 01:53:52 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk 1073741824" returned: 0 in 0.051s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.objects.instance [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'trusted_certs' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Cannot resize image /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Ensure instance console log exists: /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Start _get_guest_xml network_info=[{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': 'a9bb3ab2-4980-46ab-b6ba-aebb04b5b872', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHlJjRpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c712f2db-72cb-4136-a719-56057d82fff6', 'attached_at': '', 'detached_at': '', 'volume_id': '333bfdb2-c5a0-443a-bcc1-c203e669c896', 'serial': '333bfdb2-c5a0-443a-bcc1-c203e669c896'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:53:52 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 01:53:52 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.objects.instance [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'vcpu_model' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHlJjRpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:53:52 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:53:52 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:53:52 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.163s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f185f9-0db9-44da-ba77-c118166d5b80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:53:52 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee5d4ca-bc74-4134-a44d-20533a5a8e18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896] added
Apr 12 01:53:52 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb718a2-5faa-4fa7-8096-d5a137635456]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e55655-59f1-4ad1-8922-f80b63b54137]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hHlJjRpX {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hHlJjRpX" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ca3ebb-f50d-47bd-a564-b4a284bfb4e4]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hHlJjRpX'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Cannot resize image /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.objects.instance [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'migration_context' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f1e740-78f4-4a05-afef-5812cd85a1b0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-682748151',display_name='tempest-AttachVolumeTestJSON-server-682748151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-682748151',id=6,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2NTbVfrYVAmPq/WSiXNxhw73D4U473knUSj3S2SzGG67zJUMcYD7NdTMJnRymKmrJWRxrjStG5itGjTKaX5Cd+wZw4hLfWVikFnVEIrbrRCuVHjjCnBxwGGHScYXLHw==',key_name='tempest-keypair-663896141',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-n3kypybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:51:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=cb89325c-680a-4413-8e94-4eddfaa79c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_vif [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec368fc5-6d, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec368fc5-6d, col_values=(('external_ids', {'iface-id': 'ec368fc5-6d05-4bab-8460-cf9f1e024195', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:cb:06', 'vm-uuid': 'cb89325c-680a-4413-8e94-4eddfaa79c6b'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf4ba80-e904-4ba9-a26f-d1e1d7f31ab7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:52 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:52 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:52 user nova-compute[82184]: INFO os_vif [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d')
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a9dd9e-9918-44f0-b909-579030c13e47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260]
Apr 12 01:53:52 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260] successful.
Apr 12 01:53:52 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cd7625-85fd-4c70-941d-44bd41569d8b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b443d7f-a954-4348-b80b-68d5d51aecb2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:52 user nova-compute[82184]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)
Apr 12 01:53:52 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:53:52 user nova-compute[82184]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)
Apr 12 01:53:52 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad41767b-36fc-459a-9dba-7a803f956385]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:53:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHlJjRpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23934383535643862', 'path': '/dev/sdc'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934383535643862', 'path': '/dev/sdc'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-1476053452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:53:53 user nova-compute[82184]:   <uuid>c712f2db-72cb-4136-a719-56057d82fff6</uuid>
Apr 12 01:53:53 user nova-compute[82184]:   <name>instance-00000002</name>
Apr 12 01:53:53 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:53:53 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:53:53 user nova-compute[82184]:   <metadata>
Apr 12 01:53:53 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:53:53 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:53:53 user nova-compute[82184]:       <nova:name>tempest-ServerActionsTestJSON-server-1476053452</nova:name>
Apr 12 01:53:53 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:53:52</nova:creationTime>
Apr 12 01:53:53 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:53:53 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:53:53 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:53:53 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:53:53 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:53:53 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:53:53 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:53:53 user nova-compute[82184]:       <nova:owner>
Apr 12 01:53:53 user nova-compute[82184]:         <nova:user uuid="e8e8b9f0307b4d3fb54d89962798026b">tempest-ServerActionsTestJSON-1409832124-project-member</nova:user>
Apr 12 01:53:53 user nova-compute[82184]:         <nova:project uuid="117589cba4a54dd581f4ec5c26b4cd2a">tempest-ServerActionsTestJSON-1409832124</nova:project>
Apr 12 01:53:53 user nova-compute[82184]:       </nova:owner>
Apr 12 01:53:53 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:53:53 user nova-compute[82184]:       <nova:ports>
Apr 12 01:53:53 user nova-compute[82184]:         <nova:port uuid="365b7a91-793f-4aaf-af62-4e1c45d300e8">
Apr 12 01:53:53 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 01:53:53 user nova-compute[82184]:         </nova:port>
Apr 12 01:53:53 user nova-compute[82184]:       </nova:ports>
Apr 12 01:53:53 user nova-compute[82184]:     </nova:instance>
Apr 12 01:53:53 user nova-compute[82184]:   </metadata>
Apr 12 01:53:53 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:53:53 user nova-compute[82184]:     <system>
Apr 12 01:53:53 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:53:53 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:53:53 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:53:53 user nova-compute[82184]:       <entry name="serial">c712f2db-72cb-4136-a719-56057d82fff6</entry>
Apr 12 01:53:53 user nova-compute[82184]:       <entry name="uuid">c712f2db-72cb-4136-a719-56057d82fff6</entry>
Apr 12 01:53:53 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:53:53 user nova-compute[82184]:     </system>
Apr 12 01:53:53 user nova-compute[82184]:   </sysinfo>
Apr 12 01:53:53 user nova-compute[82184]:   <os>
Apr 12 01:53:53 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:53:53 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:53:53 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:53:53 user nova-compute[82184]:   </os>
Apr 12 01:53:53 user nova-compute[82184]:   <features>
Apr 12 01:53:53 user nova-compute[82184]:     <acpi/>
Apr 12 01:53:53 user nova-compute[82184]:     <apic/>
Apr 12 01:53:53 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:53:53 user nova-compute[82184]:   </features>
Apr 12 01:53:53 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:53:53 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:53:53 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:53:53 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:53:53 user nova-compute[82184]:   </clock>
Apr 12 01:53:53 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:53:53 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:53:53 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:53:53 user nova-compute[82184]:   </cpu>
Apr 12 01:53:53 user nova-compute[82184]:   <devices>
Apr 12 01:53:53 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:53:53 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:53:53 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk"/>
Apr 12 01:53:53 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:53:53 user nova-compute[82184]:     </disk>
Apr 12 01:53:53 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:53:53 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:53:53 user nova-compute[82184]:       <source dev="/dev/sdc"/>
Apr 12 01:53:53 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 01:53:53 user nova-compute[82184]:       <serial>333bfdb2-c5a0-443a-bcc1-c203e669c896</serial>
Apr 12 01:53:53 user nova-compute[82184]:     </disk>
Apr 12 01:53:53 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:53:53 user nova-compute[82184]:       <mac address="fa:16:3e:f9:ed:df"/>
Apr 12 01:53:53 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:53:53 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:53:53 user nova-compute[82184]:       <target dev="tap365b7a91-79"/>
Apr 12 01:53:53 user nova-compute[82184]:     </interface>
Apr 12 01:53:53 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:53:53 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/console.log" append="off"/>
Apr 12 01:53:53 user nova-compute[82184]:     </serial>
Apr 12 01:53:53 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:53:53 user nova-compute[82184]:     <video>
Apr 12 01:53:53 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:53:53 user nova-compute[82184]:     </video>
Apr 12 01:53:53 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:53:53 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:53:53 user nova-compute[82184]:     </rng>
Apr 12 01:53:53 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:53:53 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:53:53 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:53:53 user nova-compute[82184]:     </memballoon>
Apr 12 01:53:53 user nova-compute[82184]:   </devices>
Apr 12 01:53:53 user nova-compute[82184]: </domain>
Apr 12 01:53:53 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-1476053452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:53:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG os_vif [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap365b7a91-79, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap365b7a91-79, col_values=(('external_ids', {'iface-id': '365b7a91-793f-4aaf-af62-4e1c45d300e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ed:df', 'vm-uuid': 'c712f2db-72cb-4136-a719-56057d82fff6'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:53 user nova-compute[82184]: INFO os_vif [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79')
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No VIF found with MAC fa:16:3e:f9:ed:df, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-607c2fdf-344f-41d9-9530-a9a1255b56fb req-99f7d85a-a908-4fd3-8998-948c98239249 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-607c2fdf-344f-41d9-9530-a9a1255b56fb req-99f7d85a-a908-4fd3-8998-948c98239249 service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-607c2fdf-344f-41d9-9530-a9a1255b56fb req-99f7d85a-a908-4fd3-8998-948c98239249 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-607c2fdf-344f-41d9-9530-a9a1255b56fb req-99f7d85a-a908-4fd3-8998-948c98239249 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-607c2fdf-344f-41d9-9530-a9a1255b56fb req-99f7d85a-a908-4fd3-8998-948c98239249 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:54 user nova-compute[82184]: WARNING nova.compute.manager [req-607c2fdf-344f-41d9-9530-a9a1255b56fb req-99f7d85a-a908-4fd3-8998-948c98239249 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state stopped and task_state powering-on.
Apr 12 01:53:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:56 user nova-compute[82184]: WARNING nova.compute.manager [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state stopped and task_state powering-on.
Apr 12 01:53:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:56 user nova-compute[82184]: WARNING nova.compute.manager [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 01:53:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:53:56 user nova-compute[82184]: WARNING nova.compute.manager [req-53d76082-7907-402e-95a5-0148f7d87953 req-b3840f7d-7af5-49cf-a2c8-e7c97dca5d03 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264437.3673613, cb89325c-680a-4413-8e94-4eddfaa79c6b => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:57 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] VM Resumed (Lifecycle Event)
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:53:57 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance rebooted successfully.
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-36b37606-973a-4ae3-83af-a21421ab0988 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:53:57 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264437.3685226, cb89325c-680a-4413-8e94-4eddfaa79c6b => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:57 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] VM Started (Lifecycle Event)
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for c712f2db-72cb-4136-a719-56057d82fff6 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264437.7594693, c712f2db-72cb-4136-a719-56057d82fff6 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:57 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] VM Resumed (Lifecycle Event)
Apr 12 01:53:57 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance spawned successfully.
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:53:57 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264437.7616746, c712f2db-72cb-4136-a719-56057d82fff6 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:53:57 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] VM Started (Lifecycle Event)
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:53:57 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:53:57 user nova-compute[82184]: DEBUG nova.objects.instance [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82184) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 01:53:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71782933-b15b-46cc-a51a-a6bc72a51bed tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:53:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:54:06 user nova-compute[82184]: INFO nova.compute.claims [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Claim successful on node user
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:54:06 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.policy [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6c9d8100d504d1c8437b627f5564e33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdf7e36a5e4b44f690f875999b4b101a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:54:06 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Creating image(s)
Apr 12 01:54:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk 1073741824" returned: 0 in 0.049s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Cannot resize image /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'migration_context' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Successfully created port: 77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Ensure instance console log exists: /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Successfully updated port: 77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquired lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-b4cd1a96-29d2-4112-b24f-f46d41b8b158 req-69c285e8-20a6-4caf-828b-f2d37d4a75d4 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-changed-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-b4cd1a96-29d2-4112-b24f-f46d41b8b158 req-69c285e8-20a6-4caf-828b-f2d37d4a75d4 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Refreshing instance network info cache due to event network-changed-77c37f41-cbd9-4b96-a5e7-103d187fce32. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b4cd1a96-29d2-4112-b24f-f46d41b8b158 req-69c285e8-20a6-4caf-828b-f2d37d4a75d4 service nova] Acquiring lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating instance_info_cache with network_info: [{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Releasing lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Instance network_info: |[{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b4cd1a96-29d2-4112-b24f-f46d41b8b158 req-69c285e8-20a6-4caf-828b-f2d37d4a75d4 service nova] Acquired lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.network.neutron [req-b4cd1a96-29d2-4112-b24f-f46d41b8b158 req-69c285e8-20a6-4caf-828b-f2d37d4a75d4 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Refreshing network info cache for port 77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Start _get_guest_xml network_info=[{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:54:08 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:54:08 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1700354406',display_name='tempest-ServerStableDeviceRescueTest-server-1700354406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1700354406',id=16,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI/RFUfuZXI6dJ1hjD1JW2D0k8xZh+epQO+5dsrL15C9zRJbRnL07EyJ7CDIspWuf9JFtZqO5PUPIpDarEwCZLJxygT+Ba5rtS558RsdJ4Kzf5y9GMjIllAHF5H0rE0pA==',key_name='tempest-keypair-682814124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdf7e36a5e4b44f690f875999b4b101a',ramdisk_id='',reservation_id='r-00qom6go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1741311402',owner_user_name='tempest-ServerStableDeviceRescueTest-1741311402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6c9d8100d504d1c8437b627f5564e33',uuid=0d49cd12-9b4d-4a93-ad5f-bbf0536d5959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Converting VIF {"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:60:ca,bridge_name='br-int',has_traffic_filtering=True,id=77c37f41-cbd9-4b96-a5e7-103d187fce32,network=Network(849f67cf-2fe1-4792-ac08-a770ab4435c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c37f41-cb') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:54:08 user nova-compute[82184]:   <uuid>0d49cd12-9b4d-4a93-ad5f-bbf0536d5959</uuid>
Apr 12 01:54:08 user nova-compute[82184]:   <name>instance-00000010</name>
Apr 12 01:54:08 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:54:08 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:54:08 user nova-compute[82184]:   <metadata>
Apr 12 01:54:08 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:54:08 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:54:08 user nova-compute[82184]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1700354406</nova:name>
Apr 12 01:54:08 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:54:08</nova:creationTime>
Apr 12 01:54:08 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:54:08 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:54:08 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:54:08 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:54:08 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:54:08 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:54:08 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:54:08 user nova-compute[82184]:       <nova:owner>
Apr 12 01:54:08 user nova-compute[82184]:         <nova:user uuid="e6c9d8100d504d1c8437b627f5564e33">tempest-ServerStableDeviceRescueTest-1741311402-project-member</nova:user>
Apr 12 01:54:08 user nova-compute[82184]:         <nova:project uuid="cdf7e36a5e4b44f690f875999b4b101a">tempest-ServerStableDeviceRescueTest-1741311402</nova:project>
Apr 12 01:54:08 user nova-compute[82184]:       </nova:owner>
Apr 12 01:54:08 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:54:08 user nova-compute[82184]:       <nova:ports>
Apr 12 01:54:08 user nova-compute[82184]:         <nova:port uuid="77c37f41-cbd9-4b96-a5e7-103d187fce32">
Apr 12 01:54:08 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 01:54:08 user nova-compute[82184]:         </nova:port>
Apr 12 01:54:08 user nova-compute[82184]:       </nova:ports>
Apr 12 01:54:08 user nova-compute[82184]:     </nova:instance>
Apr 12 01:54:08 user nova-compute[82184]:   </metadata>
Apr 12 01:54:08 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:54:08 user nova-compute[82184]:     <system>
Apr 12 01:54:08 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:54:08 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:54:08 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:54:08 user nova-compute[82184]:       <entry name="serial">0d49cd12-9b4d-4a93-ad5f-bbf0536d5959</entry>
Apr 12 01:54:08 user nova-compute[82184]:       <entry name="uuid">0d49cd12-9b4d-4a93-ad5f-bbf0536d5959</entry>
Apr 12 01:54:08 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:54:08 user nova-compute[82184]:     </system>
Apr 12 01:54:08 user nova-compute[82184]:   </sysinfo>
Apr 12 01:54:08 user nova-compute[82184]:   <os>
Apr 12 01:54:08 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:54:08 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:54:08 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:54:08 user nova-compute[82184]:   </os>
Apr 12 01:54:08 user nova-compute[82184]:   <features>
Apr 12 01:54:08 user nova-compute[82184]:     <acpi/>
Apr 12 01:54:08 user nova-compute[82184]:     <apic/>
Apr 12 01:54:08 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:54:08 user nova-compute[82184]:   </features>
Apr 12 01:54:08 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:54:08 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:54:08 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:54:08 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:54:08 user nova-compute[82184]:   </clock>
Apr 12 01:54:08 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:54:08 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:54:08 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:54:08 user nova-compute[82184]:   </cpu>
Apr 12 01:54:08 user nova-compute[82184]:   <devices>
Apr 12 01:54:08 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:54:08 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:54:08 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk"/>
Apr 12 01:54:08 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:54:08 user nova-compute[82184]:     </disk>
Apr 12 01:54:08 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:54:08 user nova-compute[82184]:       <mac address="fa:16:3e:f4:60:ca"/>
Apr 12 01:54:08 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:54:08 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:54:08 user nova-compute[82184]:       <target dev="tap77c37f41-cb"/>
Apr 12 01:54:08 user nova-compute[82184]:     </interface>
Apr 12 01:54:08 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:54:08 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/console.log" append="off"/>
Apr 12 01:54:08 user nova-compute[82184]:     </serial>
Apr 12 01:54:08 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:54:08 user nova-compute[82184]:     <video>
Apr 12 01:54:08 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:54:08 user nova-compute[82184]:     </video>
Apr 12 01:54:08 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:54:08 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:54:08 user nova-compute[82184]:     </rng>
Apr 12 01:54:08 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:54:08 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:54:08 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:54:08 user nova-compute[82184]:     </memballoon>
Apr 12 01:54:08 user nova-compute[82184]:   </devices>
Apr 12 01:54:08 user nova-compute[82184]: </domain>
Apr 12 01:54:08 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1700354406',display_name='tempest-ServerStableDeviceRescueTest-server-1700354406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1700354406',id=16,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI/RFUfuZXI6dJ1hjD1JW2D0k8xZh+epQO+5dsrL15C9zRJbRnL07EyJ7CDIspWuf9JFtZqO5PUPIpDarEwCZLJxygT+Ba5rtS558RsdJ4Kzf5y9GMjIllAHF5H0rE0pA==',key_name='tempest-keypair-682814124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdf7e36a5e4b44f690f875999b4b101a',ramdisk_id='',reservation_id='r-00qom6go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1741311402',owner_user_name='tempest-ServerStableDeviceRescueTest-1741311402-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:54:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6c9d8100d504d1c8437b627f5564e33',uuid=0d49cd12-9b4d-4a93-ad5f-bbf0536d5959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Converting VIF {"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:60:ca,bridge_name='br-int',has_traffic_filtering=True,id=77c37f41-cbd9-4b96-a5e7-103d187fce32,network=Network(849f67cf-2fe1-4792-ac08-a770ab4435c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c37f41-cb') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG os_vif [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:60:ca,bridge_name='br-int',has_traffic_filtering=True,id=77c37f41-cbd9-4b96-a5e7-103d187fce32,network=Network(849f67cf-2fe1-4792-ac08-a770ab4435c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c37f41-cb') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77c37f41-cb, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77c37f41-cb, col_values=(('external_ids', {'iface-id': '77c37f41-cbd9-4b96-a5e7-103d187fce32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:60:ca', 'vm-uuid': '0d49cd12-9b4d-4a93-ad5f-bbf0536d5959'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:08 user nova-compute[82184]: INFO os_vif [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:60:ca,bridge_name='br-int',has_traffic_filtering=True,id=77c37f41-cbd9-4b96-a5e7-103d187fce32,network=Network(849f67cf-2fe1-4792-ac08-a770ab4435c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c37f41-cb')
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:54:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] No VIF found with MAC fa:16:3e:f4:60:ca, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:54:09 user nova-compute[82184]: DEBUG nova.network.neutron [req-b4cd1a96-29d2-4112-b24f-f46d41b8b158 req-69c285e8-20a6-4caf-828b-f2d37d4a75d4 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updated VIF entry in instance network info cache for port 77c37f41-cbd9-4b96-a5e7-103d187fce32. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:54:09 user nova-compute[82184]: DEBUG nova.network.neutron [req-b4cd1a96-29d2-4112-b24f-f46d41b8b158 req-69c285e8-20a6-4caf-828b-f2d37d4a75d4 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating instance_info_cache with network_info: [{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:54:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b4cd1a96-29d2-4112-b24f-f46d41b8b158 req-69c285e8-20a6-4caf-828b-f2d37d4a75d4 service nova] Releasing lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:54:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-edd44df3-da31-4bd2-afac-60d6329bf039 req-29f8cccb-7800-422a-8d7a-5c567d70710a service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:54:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-edd44df3-da31-4bd2-afac-60d6329bf039 req-29f8cccb-7800-422a-8d7a-5c567d70710a service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-edd44df3-da31-4bd2-afac-60d6329bf039 req-29f8cccb-7800-422a-8d7a-5c567d70710a service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-edd44df3-da31-4bd2-afac-60d6329bf039 req-29f8cccb-7800-422a-8d7a-5c567d70710a service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-edd44df3-da31-4bd2-afac-60d6329bf039 req-29f8cccb-7800-422a-8d7a-5c567d70710a service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:54:10 user nova-compute[82184]: WARNING nova.compute.manager [req-edd44df3-da31-4bd2-afac-60d6329bf039 req-29f8cccb-7800-422a-8d7a-5c567d70710a service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state building and task_state spawning.
Apr 12 01:54:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264452.4721377, 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:54:12 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] VM Resumed (Lifecycle Event)
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:54:12 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Instance spawned successfully.
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:54:12 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264452.4748864, 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:54:12 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] VM Started (Lifecycle Event)
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:54:12 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:54:12 user nova-compute[82184]: INFO nova.compute.manager [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Took 5.67 seconds to spawn the instance on the hypervisor.
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-0b88db77-35c7-469d-b5d5-9ec15cf0d5a7 req-6bc25868-a8cf-4119-b42a-9d42b94ee3c6 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0b88db77-35c7-469d-b5d5-9ec15cf0d5a7 req-6bc25868-a8cf-4119-b42a-9d42b94ee3c6 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0b88db77-35c7-469d-b5d5-9ec15cf0d5a7 req-6bc25868-a8cf-4119-b42a-9d42b94ee3c6 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0b88db77-35c7-469d-b5d5-9ec15cf0d5a7 req-6bc25868-a8cf-4119-b42a-9d42b94ee3c6 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-0b88db77-35c7-469d-b5d5-9ec15cf0d5a7 req-6bc25868-a8cf-4119-b42a-9d42b94ee3c6 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:54:12 user nova-compute[82184]: WARNING nova.compute.manager [req-0b88db77-35c7-469d-b5d5-9ec15cf0d5a7 req-6bc25868-a8cf-4119-b42a-9d42b94ee3c6 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state building and task_state spawning.
Apr 12 01:54:12 user nova-compute[82184]: INFO nova.compute.manager [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Took 6.49 seconds to build instance.
Apr 12 01:54:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2255f9dd-eaa5-46ae-af4e-7ba39e4294f7 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.589s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:33 user nova-compute[82184]: INFO nova.compute.manager [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Rescuing
Apr 12 01:54:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:54:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquired lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:54:33 user nova-compute[82184]: DEBUG nova.network.neutron [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:54:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:34 user nova-compute[82184]: DEBUG nova.network.neutron [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updating instance_info_cache with network_info: [{"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:54:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Releasing lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:54:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-464d120b-7816-4377-adde-4b3d405e77f4 req-8a920eb2-9e67-410a-b27b-5832a7c50f87 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-unplugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-464d120b-7816-4377-adde-4b3d405e77f4 req-8a920eb2-9e67-410a-b27b-5832a7c50f87 service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-464d120b-7816-4377-adde-4b3d405e77f4 req-8a920eb2-9e67-410a-b27b-5832a7c50f87 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-464d120b-7816-4377-adde-4b3d405e77f4 req-8a920eb2-9e67-410a-b27b-5832a7c50f87 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-464d120b-7816-4377-adde-4b3d405e77f4 req-8a920eb2-9e67-410a-b27b-5832a7c50f87 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-unplugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:54:35 user nova-compute[82184]: WARNING nova.compute.manager [req-464d120b-7816-4377-adde-4b3d405e77f4 req-8a920eb2-9e67-410a-b27b-5832a7c50f87 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-unplugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state active and task_state rescuing.
Apr 12 01:54:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Instance destroyed successfully.
Apr 12 01:54:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Attempting rescue
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Instance directory exists: not creating {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 01:54:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Creating image(s)
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'trusted_certs' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue" returned: 0 in 0.061s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'migration_context' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Start _get_guest_xml network_info=[{"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "vif_mac": "fa:16:3e:59:1d:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'resources' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'numa_topology' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:54:35 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:54:35 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'vcpu_model' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-722086832',display_name='tempest-ServerRescueNegativeTestJSON-server-722086832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-722086832',id=1,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-mzuyr7dh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:50:11Z,user_data=None,user_id='889189da060e4b54a48ce9a013e04a3d',uuid=fdbd8add-ac0e-42ce-9b34-5878c6bec208,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "vif_mac": "fa:16:3e:59:1d:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "vif_mac": "fa:16:3e:59:1d:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=af0cfa6a-437f-4754-87f3-f5715490cbbf,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0cfa6a-43') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'pci_devices' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:54:35 user nova-compute[82184]:   <uuid>fdbd8add-ac0e-42ce-9b34-5878c6bec208</uuid>
Apr 12 01:54:35 user nova-compute[82184]:   <name>instance-00000001</name>
Apr 12 01:54:35 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:54:35 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:54:35 user nova-compute[82184]:   <metadata>
Apr 12 01:54:35 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:54:35 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:54:35 user nova-compute[82184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-722086832</nova:name>
Apr 12 01:54:35 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:54:35</nova:creationTime>
Apr 12 01:54:35 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:54:35 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:54:35 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:54:35 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:54:35 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:54:35 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:54:35 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:54:35 user nova-compute[82184]:       <nova:owner>
Apr 12 01:54:35 user nova-compute[82184]:         <nova:user uuid="889189da060e4b54a48ce9a013e04a3d">tempest-ServerRescueNegativeTestJSON-502185932-project-member</nova:user>
Apr 12 01:54:35 user nova-compute[82184]:         <nova:project uuid="8fed0886b2404f41a659dc6356771e9c">tempest-ServerRescueNegativeTestJSON-502185932</nova:project>
Apr 12 01:54:35 user nova-compute[82184]:       </nova:owner>
Apr 12 01:54:35 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:54:35 user nova-compute[82184]:       <nova:ports>
Apr 12 01:54:35 user nova-compute[82184]:         <nova:port uuid="af0cfa6a-437f-4754-87f3-f5715490cbbf">
Apr 12 01:54:35 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 01:54:35 user nova-compute[82184]:         </nova:port>
Apr 12 01:54:35 user nova-compute[82184]:       </nova:ports>
Apr 12 01:54:35 user nova-compute[82184]:     </nova:instance>
Apr 12 01:54:35 user nova-compute[82184]:   </metadata>
Apr 12 01:54:35 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:54:35 user nova-compute[82184]:     <system>
Apr 12 01:54:35 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:54:35 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:54:35 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:54:35 user nova-compute[82184]:       <entry name="serial">fdbd8add-ac0e-42ce-9b34-5878c6bec208</entry>
Apr 12 01:54:35 user nova-compute[82184]:       <entry name="uuid">fdbd8add-ac0e-42ce-9b34-5878c6bec208</entry>
Apr 12 01:54:35 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:54:35 user nova-compute[82184]:     </system>
Apr 12 01:54:35 user nova-compute[82184]:   </sysinfo>
Apr 12 01:54:35 user nova-compute[82184]:   <os>
Apr 12 01:54:35 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:54:35 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:54:35 user nova-compute[82184]:   </os>
Apr 12 01:54:35 user nova-compute[82184]:   <features>
Apr 12 01:54:35 user nova-compute[82184]:     <acpi/>
Apr 12 01:54:35 user nova-compute[82184]:     <apic/>
Apr 12 01:54:35 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:54:35 user nova-compute[82184]:   </features>
Apr 12 01:54:35 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:54:35 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:54:35 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:54:35 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:54:35 user nova-compute[82184]:   </clock>
Apr 12 01:54:35 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:54:35 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:54:35 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:54:35 user nova-compute[82184]:   </cpu>
Apr 12 01:54:35 user nova-compute[82184]:   <devices>
Apr 12 01:54:35 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:54:35 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:54:35 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue"/>
Apr 12 01:54:35 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:54:35 user nova-compute[82184]:     </disk>
Apr 12 01:54:35 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:54:35 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:54:35 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk"/>
Apr 12 01:54:35 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 01:54:35 user nova-compute[82184]:     </disk>
Apr 12 01:54:35 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:54:35 user nova-compute[82184]:       <mac address="fa:16:3e:59:1d:2d"/>
Apr 12 01:54:35 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:54:35 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:54:35 user nova-compute[82184]:       <target dev="tapaf0cfa6a-43"/>
Apr 12 01:54:35 user nova-compute[82184]:     </interface>
Apr 12 01:54:35 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:54:35 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/console.log" append="off"/>
Apr 12 01:54:35 user nova-compute[82184]:     </serial>
Apr 12 01:54:35 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:54:35 user nova-compute[82184]:     <video>
Apr 12 01:54:35 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:54:35 user nova-compute[82184]:     </video>
Apr 12 01:54:35 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:54:35 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:54:35 user nova-compute[82184]:     </rng>
Apr 12 01:54:35 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:54:35 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:54:35 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:54:35 user nova-compute[82184]:     </memballoon>
Apr 12 01:54:35 user nova-compute[82184]:   </devices>
Apr 12 01:54:35 user nova-compute[82184]: </domain>
Apr 12 01:54:35 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:54:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Instance destroyed successfully.
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:54:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No VIF found with MAC fa:16:3e:59:1d:2d, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:54:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-dc0025eb-6ab0-4301-b565-fee55b0c0283 req-d992e79e-5925-4e22-872d-c73c0fe09eed service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:54:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-dc0025eb-6ab0-4301-b565-fee55b0c0283 req-d992e79e-5925-4e22-872d-c73c0fe09eed service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-dc0025eb-6ab0-4301-b565-fee55b0c0283 req-d992e79e-5925-4e22-872d-c73c0fe09eed service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-dc0025eb-6ab0-4301-b565-fee55b0c0283 req-d992e79e-5925-4e22-872d-c73c0fe09eed service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-dc0025eb-6ab0-4301-b565-fee55b0c0283 req-d992e79e-5925-4e22-872d-c73c0fe09eed service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:54:37 user nova-compute[82184]: WARNING nova.compute.manager [req-dc0025eb-6ab0-4301-b565-fee55b0c0283 req-d992e79e-5925-4e22-872d-c73c0fe09eed service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state active and task_state rescuing.
Apr 12 01:54:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:54:39 user nova-compute[82184]: WARNING nova.compute.manager [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state active and task_state rescuing.
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:54:39 user nova-compute[82184]: WARNING nova.compute.manager [req-1242832d-7bb1-483e-8848-a2fdd0817d58 req-859d49a6-cc49-4888-9d6f-3f4dbe6cd736 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state active and task_state rescuing.
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for fdbd8add-ac0e-42ce-9b34-5878c6bec208 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264479.3312476, fdbd8add-ac0e-42ce-9b34-5878c6bec208 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:54:39 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] VM Resumed (Lifecycle Event)
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7bb219d7-e0f1-4699-943d-560190607343 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:54:39 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264479.336615, fdbd8add-ac0e-42ce-9b34-5878c6bec208 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:54:39 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] VM Started (Lifecycle Event)
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:54:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:54:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:54:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:43 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:54:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:48 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:54:48 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=7657MB free_disk=26.514942169189453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cb89325c-680a-4413-8e94-4eddfaa79c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2acd2ee1-172a-4984-85ed-52a8e78aafb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fd946144-5343-4788-b04d-ca1ed81afce9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 9fa9bdbe-ee75-425e-bed5-049fdf908d09 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:54:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:54:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:54:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updating instance_info_cache with network_info: [{"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:54:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:54:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:54:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:01 user nova-compute[82184]: DEBUG nova.compute.manager [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:55:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:55:01 user nova-compute[82184]: INFO nova.compute.claims [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Claim successful on node user
Apr 12 01:55:01 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:55:01 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:55:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:01 user nova-compute[82184]: DEBUG nova.compute.manager [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.network.neutron [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:55:02 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:55:02 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Creating image(s)
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.policy [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43819af3565d4eff92ce1a51f86df4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3443faad6b314920a85b8491603e30ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk 1073741824" returned: 0 in 0.049s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Cannot resize image /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.objects.instance [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lazy-loading 'migration_context' on Instance uuid 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Ensure instance console log exists: /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:02 user nova-compute[82184]: DEBUG nova.network.neutron [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Successfully created port: 0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:55:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.neutron [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Successfully updated port: 0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquired lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.neutron [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.neutron [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.compute.manager [req-c51d8045-a2a1-4644-8409-f1918e05459f req-d035f468-3380-4350-804e-4bae7d494057 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-changed-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.compute.manager [req-c51d8045-a2a1-4644-8409-f1918e05459f req-d035f468-3380-4350-804e-4bae7d494057 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Refreshing instance network info cache due to event network-changed-0e649e0b-d93b-473c-a765-b0173cea1a6d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c51d8045-a2a1-4644-8409-f1918e05459f req-d035f468-3380-4350-804e-4bae7d494057 service nova] Acquiring lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.neutron [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updating instance_info_cache with network_info: [{"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Releasing lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.compute.manager [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Instance network_info: |[{"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c51d8045-a2a1-4644-8409-f1918e05459f req-d035f468-3380-4350-804e-4bae7d494057 service nova] Acquired lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.neutron [req-c51d8045-a2a1-4644-8409-f1918e05459f req-d035f468-3380-4350-804e-4bae7d494057 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Refreshing network info cache for port 0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Start _get_guest_xml network_info=[{"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:55:04 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:55:04 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211209472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-211209472',id=17,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlxYLGiDT3ULykrJ/16FAYLe9mlS7WpoHsNkE+Oww0i5S0/0HEU1ZMf1BlJ8O7u24iaXO1qwL8Qcg5/TeN5uRr2keoVwu2xaLtJctivU4Ipg77M6FqVNyx8y2JxOGS9rQ==',key_name='tempest-keypair-1476535441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3443faad6b314920a85b8491603e30ac',ramdisk_id='',reservation_id='r-jpcow580',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1804071739',owner_user_name='tempest-TaggedAttachmentsTest-1804071739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43819af3565d4eff92ce1a51f86df4f2',uuid=5b7cbacb-f776-4e9a-b333-ce9c345dc525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converting VIF {"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:a5:b3,bridge_name='br-int',has_traffic_filtering=True,id=0e649e0b-d93b-473c-a765-b0173cea1a6d,network=Network(988b3410-7746-4c36-99ce-5bab176cefe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e649e0b-d9') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.objects.instance [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:55:04 user nova-compute[82184]:   <uuid>5b7cbacb-f776-4e9a-b333-ce9c345dc525</uuid>
Apr 12 01:55:04 user nova-compute[82184]:   <name>instance-00000011</name>
Apr 12 01:55:04 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:55:04 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:55:04 user nova-compute[82184]:   <metadata>
Apr 12 01:55:04 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:55:04 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:55:04 user nova-compute[82184]:       <nova:name>tempest-device-tagging-server-211209472</nova:name>
Apr 12 01:55:04 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:55:04</nova:creationTime>
Apr 12 01:55:04 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:55:04 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:55:04 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:55:04 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:55:04 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:55:04 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:55:04 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:55:04 user nova-compute[82184]:       <nova:owner>
Apr 12 01:55:04 user nova-compute[82184]:         <nova:user uuid="43819af3565d4eff92ce1a51f86df4f2">tempest-TaggedAttachmentsTest-1804071739-project-member</nova:user>
Apr 12 01:55:04 user nova-compute[82184]:         <nova:project uuid="3443faad6b314920a85b8491603e30ac">tempest-TaggedAttachmentsTest-1804071739</nova:project>
Apr 12 01:55:04 user nova-compute[82184]:       </nova:owner>
Apr 12 01:55:04 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:55:04 user nova-compute[82184]:       <nova:ports>
Apr 12 01:55:04 user nova-compute[82184]:         <nova:port uuid="0e649e0b-d93b-473c-a765-b0173cea1a6d">
Apr 12 01:55:04 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 01:55:04 user nova-compute[82184]:         </nova:port>
Apr 12 01:55:04 user nova-compute[82184]:       </nova:ports>
Apr 12 01:55:04 user nova-compute[82184]:     </nova:instance>
Apr 12 01:55:04 user nova-compute[82184]:   </metadata>
Apr 12 01:55:04 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:55:04 user nova-compute[82184]:     <system>
Apr 12 01:55:04 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:55:04 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:55:04 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:55:04 user nova-compute[82184]:       <entry name="serial">5b7cbacb-f776-4e9a-b333-ce9c345dc525</entry>
Apr 12 01:55:04 user nova-compute[82184]:       <entry name="uuid">5b7cbacb-f776-4e9a-b333-ce9c345dc525</entry>
Apr 12 01:55:04 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:55:04 user nova-compute[82184]:     </system>
Apr 12 01:55:04 user nova-compute[82184]:   </sysinfo>
Apr 12 01:55:04 user nova-compute[82184]:   <os>
Apr 12 01:55:04 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:55:04 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:55:04 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:55:04 user nova-compute[82184]:   </os>
Apr 12 01:55:04 user nova-compute[82184]:   <features>
Apr 12 01:55:04 user nova-compute[82184]:     <acpi/>
Apr 12 01:55:04 user nova-compute[82184]:     <apic/>
Apr 12 01:55:04 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:55:04 user nova-compute[82184]:   </features>
Apr 12 01:55:04 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:55:04 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:55:04 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:55:04 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:55:04 user nova-compute[82184]:   </clock>
Apr 12 01:55:04 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:55:04 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:55:04 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:55:04 user nova-compute[82184]:   </cpu>
Apr 12 01:55:04 user nova-compute[82184]:   <devices>
Apr 12 01:55:04 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:55:04 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:55:04 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk"/>
Apr 12 01:55:04 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:55:04 user nova-compute[82184]:     </disk>
Apr 12 01:55:04 user nova-compute[82184]:     <disk type="file" device="cdrom">
Apr 12 01:55:04 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 01:55:04 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk.config"/>
Apr 12 01:55:04 user nova-compute[82184]:       <target dev="hda" bus="ide"/>
Apr 12 01:55:04 user nova-compute[82184]:     </disk>
Apr 12 01:55:04 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:55:04 user nova-compute[82184]:       <mac address="fa:16:3e:11:a5:b3"/>
Apr 12 01:55:04 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:55:04 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:55:04 user nova-compute[82184]:       <target dev="tap0e649e0b-d9"/>
Apr 12 01:55:04 user nova-compute[82184]:     </interface>
Apr 12 01:55:04 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:55:04 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/console.log" append="off"/>
Apr 12 01:55:04 user nova-compute[82184]:     </serial>
Apr 12 01:55:04 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:55:04 user nova-compute[82184]:     <video>
Apr 12 01:55:04 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:55:04 user nova-compute[82184]:     </video>
Apr 12 01:55:04 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:55:04 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:55:04 user nova-compute[82184]:     </rng>
Apr 12 01:55:04 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:55:04 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:55:04 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:55:04 user nova-compute[82184]:     </memballoon>
Apr 12 01:55:04 user nova-compute[82184]:   </devices>
Apr 12 01:55:04 user nova-compute[82184]: </domain>
Apr 12 01:55:04 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211209472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-211209472',id=17,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlxYLGiDT3ULykrJ/16FAYLe9mlS7WpoHsNkE+Oww0i5S0/0HEU1ZMf1BlJ8O7u24iaXO1qwL8Qcg5/TeN5uRr2keoVwu2xaLtJctivU4Ipg77M6FqVNyx8y2JxOGS9rQ==',key_name='tempest-keypair-1476535441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3443faad6b314920a85b8491603e30ac',ramdisk_id='',reservation_id='r-jpcow580',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1804071739',owner_user_name='tempest-TaggedAttachmentsTest-1804071739-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43819af3565d4eff92ce1a51f86df4f2',uuid=5b7cbacb-f776-4e9a-b333-ce9c345dc525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converting VIF {"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:a5:b3,bridge_name='br-int',has_traffic_filtering=True,id=0e649e0b-d93b-473c-a765-b0173cea1a6d,network=Network(988b3410-7746-4c36-99ce-5bab176cefe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e649e0b-d9') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG os_vif [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:a5:b3,bridge_name='br-int',has_traffic_filtering=True,id=0e649e0b-d93b-473c-a765-b0173cea1a6d,network=Network(988b3410-7746-4c36-99ce-5bab176cefe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e649e0b-d9') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e649e0b-d9, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e649e0b-d9, col_values=(('external_ids', {'iface-id': '0e649e0b-d93b-473c-a765-b0173cea1a6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:a5:b3', 'vm-uuid': '5b7cbacb-f776-4e9a-b333-ce9c345dc525'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:04 user nova-compute[82184]: INFO os_vif [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:a5:b3,bridge_name='br-int',has_traffic_filtering=True,id=0e649e0b-d93b-473c-a765-b0173cea1a6d,network=Network(988b3410-7746-4c36-99ce-5bab176cefe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e649e0b-d9')
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] No BDM found with device name hda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] No VIF found with MAC fa:16:3e:11:a5:b3, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:55:04 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Using config drive
Apr 12 01:55:04 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Creating config drive at /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk.config
Apr 12 01:55:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdfj1i2r9 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdfj1i2r9" returned: 0 in 0.073s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.neutron [req-c51d8045-a2a1-4644-8409-f1918e05459f req-d035f468-3380-4350-804e-4bae7d494057 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updated VIF entry in instance network info cache for port 0e649e0b-d93b-473c-a765-b0173cea1a6d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:55:04 user nova-compute[82184]: DEBUG nova.network.neutron [req-c51d8045-a2a1-4644-8409-f1918e05459f req-d035f468-3380-4350-804e-4bae7d494057 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updating instance_info_cache with network_info: [{"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:55:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c51d8045-a2a1-4644-8409-f1918e05459f req-d035f468-3380-4350-804e-4bae7d494057 service nova] Releasing lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:06 user nova-compute[82184]: INFO nova.compute.manager [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Terminating instance
Apr 12 01:55:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-a42ddc7a-5118-4d18-8afd-e7341682fddd req-43aaf56a-6879-418b-8b4b-e17925e1e8de service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-plugged-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a42ddc7a-5118-4d18-8afd-e7341682fddd req-43aaf56a-6879-418b-8b4b-e17925e1e8de service nova] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a42ddc7a-5118-4d18-8afd-e7341682fddd req-43aaf56a-6879-418b-8b4b-e17925e1e8de service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a42ddc7a-5118-4d18-8afd-e7341682fddd req-43aaf56a-6879-418b-8b4b-e17925e1e8de service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-a42ddc7a-5118-4d18-8afd-e7341682fddd req-43aaf56a-6879-418b-8b4b-e17925e1e8de service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] No waiting events found dispatching network-vif-plugged-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:06 user nova-compute[82184]: WARNING nova.compute.manager [req-a42ddc7a-5118-4d18-8afd-e7341682fddd req-43aaf56a-6879-418b-8b4b-e17925e1e8de service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received unexpected event network-vif-plugged-0e649e0b-d93b-473c-a765-b0173cea1a6d for instance with vm_state building and task_state spawning.
Apr 12 01:55:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-9e24a2ba-6fd4-416a-9aa2-0ba78e3bf86d req-40640996-2a8e-490c-98aa-03dd1e1c3e86 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received event network-vif-unplugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9e24a2ba-6fd4-416a-9aa2-0ba78e3bf86d req-40640996-2a8e-490c-98aa-03dd1e1c3e86 service nova] Acquiring lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9e24a2ba-6fd4-416a-9aa2-0ba78e3bf86d req-40640996-2a8e-490c-98aa-03dd1e1c3e86 service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9e24a2ba-6fd4-416a-9aa2-0ba78e3bf86d req-40640996-2a8e-490c-98aa-03dd1e1c3e86 service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-9e24a2ba-6fd4-416a-9aa2-0ba78e3bf86d req-40640996-2a8e-490c-98aa-03dd1e1c3e86 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] No waiting events found dispatching network-vif-unplugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-9e24a2ba-6fd4-416a-9aa2-0ba78e3bf86d req-40640996-2a8e-490c-98aa-03dd1e1c3e86 service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received event network-vif-unplugged-d01d48de-8685-4de9-a1d2-e13833a4b274 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:07 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Instance destroyed successfully.
Apr 12 01:55:07 user nova-compute[82184]: DEBUG nova.objects.instance [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lazy-loading 'resources' on Instance uuid 2acd2ee1-172a-4984-85ed-52a8e78aafb9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-842559334',display_name='tempest-VolumesAdminNegativeTest-server-842559334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-842559334',id=13,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:53:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0dd135bd60941dbb68b3e677c4878e9',ramdisk_id='',reservation_id='r-4vpdbi6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-312412096',owner_user_name='tempest-VolumesAdminNegativeTest-312412096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:53:18Z,user_data=None,user_id='aeb7fd40946e43dc860d63bb8958d633',uuid=2acd2ee1-172a-4984-85ed-52a8e78aafb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d01d48de-8685-4de9-a1d2-e13833a4b274", "address": "fa:16:3e:0b:9a:18", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01d48de-86", "ovs_interfaceid": "d01d48de-8685-4de9-a1d2-e13833a4b274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converting VIF {"id": "d01d48de-8685-4de9-a1d2-e13833a4b274", "address": "fa:16:3e:0b:9a:18", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd01d48de-86", "ovs_interfaceid": "d01d48de-8685-4de9-a1d2-e13833a4b274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9a:18,bridge_name='br-int',has_traffic_filtering=True,id=d01d48de-8685-4de9-a1d2-e13833a4b274,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01d48de-86') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG os_vif [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9a:18,bridge_name='br-int',has_traffic_filtering=True,id=d01d48de-8685-4de9-a1d2-e13833a4b274,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01d48de-86') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd01d48de-86, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:07 user nova-compute[82184]: INFO os_vif [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:9a:18,bridge_name='br-int',has_traffic_filtering=True,id=d01d48de-8685-4de9-a1d2-e13833a4b274,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd01d48de-86')
Apr 12 01:55:07 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Deleting instance files /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9_del
Apr 12 01:55:07 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Deletion of /opt/stack/data/nova/instances/2acd2ee1-172a-4984-85ed-52a8e78aafb9_del complete
Apr 12 01:55:07 user nova-compute[82184]: INFO nova.compute.manager [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 12 01:55:07 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:55:08 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Took 0.83 seconds to deallocate network for instance.
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264508.465421, 5b7cbacb-f776-4e9a-b333-ce9c345dc525 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:55:08 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] VM Resumed (Lifecycle Event)
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:55:08 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Instance spawned successfully.
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:55:08 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264508.4670131, 5b7cbacb-f776-4e9a-b333-ce9c345dc525 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:55:08 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] VM Started (Lifecycle Event)
Apr 12 01:55:08 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Deleted allocations for instance 2acd2ee1-172a-4984-85ed-52a8e78aafb9
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:55:08 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:55:08 user nova-compute[82184]: INFO nova.compute.manager [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Took 6.44 seconds to spawn the instance on the hypervisor.
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-03f71882-59ab-4f4f-aa7a-53f3b7f14e90 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.086s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:08 user nova-compute[82184]: INFO nova.compute.manager [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Took 7.31 seconds to build instance.
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-aea80848-b6df-4b2f-a36d-e7487d82a4a9 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.411s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-742e7a90-cda4-41c5-bc85-2f686592025d req-c6f09116-226d-467d-a8bd-ae8901cb2ae7 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-plugged-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-742e7a90-cda4-41c5-bc85-2f686592025d req-c6f09116-226d-467d-a8bd-ae8901cb2ae7 service nova] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-742e7a90-cda4-41c5-bc85-2f686592025d req-c6f09116-226d-467d-a8bd-ae8901cb2ae7 service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-742e7a90-cda4-41c5-bc85-2f686592025d req-c6f09116-226d-467d-a8bd-ae8901cb2ae7 service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-742e7a90-cda4-41c5-bc85-2f686592025d req-c6f09116-226d-467d-a8bd-ae8901cb2ae7 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] No waiting events found dispatching network-vif-plugged-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:08 user nova-compute[82184]: WARNING nova.compute.manager [req-742e7a90-cda4-41c5-bc85-2f686592025d req-c6f09116-226d-467d-a8bd-ae8901cb2ae7 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received unexpected event network-vif-plugged-0e649e0b-d93b-473c-a765-b0173cea1a6d for instance with vm_state active and task_state None.
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Acquiring lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] No waiting events found dispatching network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:08 user nova-compute[82184]: WARNING nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received unexpected event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 for instance with vm_state deleted and task_state None.
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Acquiring lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] No waiting events found dispatching network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:08 user nova-compute[82184]: WARNING nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received unexpected event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 for instance with vm_state deleted and task_state None.
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Acquiring lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] No waiting events found dispatching network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:08 user nova-compute[82184]: WARNING nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received unexpected event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 for instance with vm_state deleted and task_state None.
Apr 12 01:55:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Acquiring lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] Lock "2acd2ee1-172a-4984-85ed-52a8e78aafb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] No waiting events found dispatching network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:09 user nova-compute[82184]: WARNING nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received unexpected event network-vif-plugged-d01d48de-8685-4de9-a1d2-e13833a4b274 for instance with vm_state deleted and task_state None.
Apr 12 01:55:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ce0a743-1bf2-4ea5-9cd0-834a3006d666 req-18fca5ac-1d27-4894-a06d-2efe56c0a76f service nova] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Received event network-vif-deleted-d01d48de-8685-4de9-a1d2-e13833a4b274 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:21 user nova-compute[82184]: INFO nova.compute.manager [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Terminating instance
Apr 12 01:55:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-ff2af2b5-2a87-4000-9b93-475a35909902 req-e5a72f7b-12bf-4001-8279-efc0ec0d4958 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Received event network-vif-unplugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ff2af2b5-2a87-4000-9b93-475a35909902 req-e5a72f7b-12bf-4001-8279-efc0ec0d4958 service nova] Acquiring lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ff2af2b5-2a87-4000-9b93-475a35909902 req-e5a72f7b-12bf-4001-8279-efc0ec0d4958 service nova] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ff2af2b5-2a87-4000-9b93-475a35909902 req-e5a72f7b-12bf-4001-8279-efc0ec0d4958 service nova] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-ff2af2b5-2a87-4000-9b93-475a35909902 req-e5a72f7b-12bf-4001-8279-efc0ec0d4958 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] No waiting events found dispatching network-vif-unplugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-ff2af2b5-2a87-4000-9b93-475a35909902 req-e5a72f7b-12bf-4001-8279-efc0ec0d4958 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Received event network-vif-unplugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:21 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Instance destroyed successfully.
Apr 12 01:55:21 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lazy-loading 'resources' on Instance uuid 9fa9bdbe-ee75-425e-bed5-049fdf908d09 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1600919856',display_name='tempest-VolumesActionsTest-instance-1600919856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1600919856',id=15,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:53:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce361b6fa374bca8dc0a48a53ad54f9',ramdisk_id='',reservation_id='r-ah6iic14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-89585441',owner_user_name='tempest-VolumesActionsTest-89585441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:53:39Z,user_data=None,user_id='4d876b30b1724669a8d7e8bd543fa18c',uuid=9fa9bdbe-ee75-425e-bed5-049fdf908d09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "address": "fa:16:3e:0a:cf:b4", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a900b27-d2", "ovs_interfaceid": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converting VIF {"id": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "address": "fa:16:3e:0a:cf:b4", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a900b27-d2", "ovs_interfaceid": "0a900b27-d2bd-420d-a5cf-1df8fee01d93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cf:b4,bridge_name='br-int',has_traffic_filtering=True,id=0a900b27-d2bd-420d-a5cf-1df8fee01d93,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a900b27-d2') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG os_vif [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cf:b4,bridge_name='br-int',has_traffic_filtering=True,id=0a900b27-d2bd-420d-a5cf-1df8fee01d93,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a900b27-d2') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a900b27-d2, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:21 user nova-compute[82184]: INFO os_vif [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:cf:b4,bridge_name='br-int',has_traffic_filtering=True,id=0a900b27-d2bd-420d-a5cf-1df8fee01d93,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a900b27-d2')
Apr 12 01:55:21 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Deleting instance files /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09_del
Apr 12 01:55:21 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Deletion of /opt/stack/data/nova/instances/9fa9bdbe-ee75-425e-bed5-049fdf908d09_del complete
Apr 12 01:55:21 user nova-compute[82184]: INFO nova.compute.manager [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 12 01:55:21 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:55:21 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:55:22 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264507.1496365, 2acd2ee1-172a-4984-85ed-52a8e78aafb9 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:55:22 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] VM Stopped (Lifecycle Event)
Apr 12 01:55:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b5b65d39-1493-4cb7-95d9-65f88ae8f628 None None] [instance: 2acd2ee1-172a-4984-85ed-52a8e78aafb9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:55:22 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:55:22 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Took 0.58 seconds to deallocate network for instance.
Apr 12 01:55:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-77ff1df6-4012-4c6f-ad81-d9d3cf588d53 req-94becc71-c1c6-467c-b709-8af33d65da70 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Received event network-vif-deleted-0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:22 user nova-compute[82184]: INFO nova.compute.manager [req-77ff1df6-4012-4c6f-ad81-d9d3cf588d53 req-94becc71-c1c6-467c-b709-8af33d65da70 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Neutron deleted interface 0a900b27-d2bd-420d-a5cf-1df8fee01d93; detaching it from the instance and deleting it from the info cache
Apr 12 01:55:22 user nova-compute[82184]: DEBUG nova.network.neutron [req-77ff1df6-4012-4c6f-ad81-d9d3cf588d53 req-94becc71-c1c6-467c-b709-8af33d65da70 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:55:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-77ff1df6-4012-4c6f-ad81-d9d3cf588d53 req-94becc71-c1c6-467c-b709-8af33d65da70 service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Detach interface failed, port_id=0a900b27-d2bd-420d-a5cf-1df8fee01d93, reason: Instance 9fa9bdbe-ee75-425e-bed5-049fdf908d09 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:55:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:22 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:55:22 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:55:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:22 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Deleted allocations for instance 9fa9bdbe-ee75-425e-bed5-049fdf908d09
Apr 12 01:55:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6ba98eb-a9cf-43a6-a95f-335172e816a1 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-76208571-070f-4397-b740-736e072cd48d req-bc2f3567-7ef6-4d5e-b1f7-0010088b3adb service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Received event network-vif-plugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-76208571-070f-4397-b740-736e072cd48d req-bc2f3567-7ef6-4d5e-b1f7-0010088b3adb service nova] Acquiring lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-76208571-070f-4397-b740-736e072cd48d req-bc2f3567-7ef6-4d5e-b1f7-0010088b3adb service nova] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-76208571-070f-4397-b740-736e072cd48d req-bc2f3567-7ef6-4d5e-b1f7-0010088b3adb service nova] Lock "9fa9bdbe-ee75-425e-bed5-049fdf908d09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-76208571-070f-4397-b740-736e072cd48d req-bc2f3567-7ef6-4d5e-b1f7-0010088b3adb service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] No waiting events found dispatching network-vif-plugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:23 user nova-compute[82184]: WARNING nova.compute.manager [req-76208571-070f-4397-b740-736e072cd48d req-bc2f3567-7ef6-4d5e-b1f7-0010088b3adb service nova] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Received unexpected event network-vif-plugged-0a900b27-d2bd-420d-a5cf-1df8fee01d93 for instance with vm_state deleted and task_state None.
Apr 12 01:55:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Acquiring lock "fd946144-5343-4788-b04d-ca1ed81afce9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "fd946144-5343-4788-b04d-ca1ed81afce9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Acquiring lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:24 user nova-compute[82184]: INFO nova.compute.manager [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Terminating instance
Apr 12 01:55:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:55:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-02c95798-697c-41e3-b8f8-c39124aa33bb req-27ea7d73-135e-4331-b015-51e386093ab4 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Received event network-vif-unplugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-02c95798-697c-41e3-b8f8-c39124aa33bb req-27ea7d73-135e-4331-b015-51e386093ab4 service nova] Acquiring lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-02c95798-697c-41e3-b8f8-c39124aa33bb req-27ea7d73-135e-4331-b015-51e386093ab4 service nova] Lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-02c95798-697c-41e3-b8f8-c39124aa33bb req-27ea7d73-135e-4331-b015-51e386093ab4 service nova] Lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-02c95798-697c-41e3-b8f8-c39124aa33bb req-27ea7d73-135e-4331-b015-51e386093ab4 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] No waiting events found dispatching network-vif-unplugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-02c95798-697c-41e3-b8f8-c39124aa33bb req-27ea7d73-135e-4331-b015-51e386093ab4 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Received event network-vif-unplugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:55:25 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Instance destroyed successfully.
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.objects.instance [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lazy-loading 'resources' on Instance uuid fd946144-5343-4788-b04d-ca1ed81afce9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:53:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1114639621',display_name='tempest-VolumesActionsTest-instance-1114639621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1114639621',id=14,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:53:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32e80d0c6d6f44c786b1053c0547de3b',ramdisk_id='',reservation_id='r-uuohpjqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-621357222',owner_user_name='tempest-VolumesActionsTest-621357222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:53:39Z,user_data=None,user_id='a92cd627a1c04cedacc4aa3e2398b960',uuid=fd946144-5343-4788-b04d-ca1ed81afce9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "address": "fa:16:3e:10:f9:ee", "network": {"id": "519f5539-952c-455f-aae3-420bb4c92b09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1460084896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "32e80d0c6d6f44c786b1053c0547de3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aae11f1-3c", "ovs_interfaceid": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Converting VIF {"id": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "address": "fa:16:3e:10:f9:ee", "network": {"id": "519f5539-952c-455f-aae3-420bb4c92b09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1460084896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "32e80d0c6d6f44c786b1053c0547de3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3aae11f1-3c", "ovs_interfaceid": "3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:ee,bridge_name='br-int',has_traffic_filtering=True,id=3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e,network=Network(519f5539-952c-455f-aae3-420bb4c92b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aae11f1-3c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG os_vif [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:ee,bridge_name='br-int',has_traffic_filtering=True,id=3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e,network=Network(519f5539-952c-455f-aae3-420bb4c92b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aae11f1-3c') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3aae11f1-3c, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:55:25 user nova-compute[82184]: INFO os_vif [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:f9:ee,bridge_name='br-int',has_traffic_filtering=True,id=3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e,network=Network(519f5539-952c-455f-aae3-420bb4c92b09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3aae11f1-3c')
Apr 12 01:55:25 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Deleting instance files /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9_del
Apr 12 01:55:25 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Deletion of /opt/stack/data/nova/instances/fd946144-5343-4788-b04d-ca1ed81afce9_del complete
Apr 12 01:55:25 user nova-compute[82184]: INFO nova.compute.manager [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 12 01:55:25 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:55:25 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Took 0.43 seconds to deallocate network for instance.
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-a25b78ca-a4ec-4cfe-a881-3e64ba541374 req-8b218904-0b66-4508-8e11-b52571ff8667 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Received event network-vif-deleted-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:25 user nova-compute[82184]: INFO nova.compute.manager [req-a25b78ca-a4ec-4cfe-a881-3e64ba541374 req-8b218904-0b66-4508-8e11-b52571ff8667 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Neutron deleted interface 3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e; detaching it from the instance and deleting it from the info cache
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.network.neutron [req-a25b78ca-a4ec-4cfe-a881-3e64ba541374 req-8b218904-0b66-4508-8e11-b52571ff8667 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:55:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-a25b78ca-a4ec-4cfe-a881-3e64ba541374 req-8b218904-0b66-4508-8e11-b52571ff8667 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Detach interface failed, port_id=3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e, reason: Instance fd946144-5343-4788-b04d-ca1ed81afce9 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:55:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:26 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:55:26 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:55:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:26 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Deleted allocations for instance fd946144-5343-4788-b04d-ca1ed81afce9
Apr 12 01:55:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f33c8e95-9944-4ea7-aeb7-9e1fdaf56188 tempest-VolumesActionsTest-621357222 tempest-VolumesActionsTest-621357222-project-member] Lock "fd946144-5343-4788-b04d-ca1ed81afce9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.596s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-223f7102-ba4b-4c4b-a5a5-31db68f7dcc7 req-6cdbc263-e954-4bc2-b956-32e19f0674b3 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Received event network-vif-plugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-223f7102-ba4b-4c4b-a5a5-31db68f7dcc7 req-6cdbc263-e954-4bc2-b956-32e19f0674b3 service nova] Acquiring lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-223f7102-ba4b-4c4b-a5a5-31db68f7dcc7 req-6cdbc263-e954-4bc2-b956-32e19f0674b3 service nova] Lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-223f7102-ba4b-4c4b-a5a5-31db68f7dcc7 req-6cdbc263-e954-4bc2-b956-32e19f0674b3 service nova] Lock "fd946144-5343-4788-b04d-ca1ed81afce9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-223f7102-ba4b-4c4b-a5a5-31db68f7dcc7 req-6cdbc263-e954-4bc2-b956-32e19f0674b3 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] No waiting events found dispatching network-vif-plugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:27 user nova-compute[82184]: WARNING nova.compute.manager [req-223f7102-ba4b-4c4b-a5a5-31db68f7dcc7 req-6cdbc263-e954-4bc2-b956-32e19f0674b3 service nova] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Received unexpected event network-vif-plugged-3aae11f1-3c64-48bf-9a1f-6e6ac2bc844e for instance with vm_state deleted and task_state None.
Apr 12 01:55:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:36 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264521.760141, 9fa9bdbe-ee75-425e-bed5-049fdf908d09 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:55:36 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] VM Stopped (Lifecycle Event)
Apr 12 01:55:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e35020f0-3e4b-4bb1-94b1-37e4e89fea4f None None] [instance: 9fa9bdbe-ee75-425e-bed5-049fdf908d09] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:55:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 01:55:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 01:55:38 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 01:55:38 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:40 user nova-compute[82184]: INFO nova.compute.manager [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Detaching volume 52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:55:40 user nova-compute[82184]: INFO nova.virt.block_device [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Attempting to driver detach volume 52725f14-a644-4019-b7c6-9547d83cfb1b from mountpoint /dev/vdb
Apr 12 01:55:40 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264525.441948, fd946144-5343-4788-b04d-ca1ed81afce9 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:55:40 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] VM Stopped (Lifecycle Event)
Apr 12 01:55:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Attempting to detach device vdb from instance cb89325c-680a-4413-8e94-4eddfaa79c6b from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:55:40 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:55:40 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 01:55:40 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:55:40 user nova-compute[82184]:   <serial>52725f14-a644-4019-b7c6-9547d83cfb1b</serial>
Apr 12 01:55:40 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 01:55:40 user nova-compute[82184]: </disk>
Apr 12 01:55:40 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:55:40 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully detached device vdb from instance cb89325c-680a-4413-8e94-4eddfaa79c6b from the persistent domain config.
Apr 12 01:55:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb89325c-680a-4413-8e94-4eddfaa79c6b from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:55:40 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:55:40 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 01:55:40 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:55:40 user nova-compute[82184]:   <serial>52725f14-a644-4019-b7c6-9547d83cfb1b</serial>
Apr 12 01:55:40 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 01:55:40 user nova-compute[82184]: </disk>
Apr 12 01:55:40 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f4576360-4811-404c-b675-72a526a8af7c None None] [instance: fd946144-5343-4788-b04d-ca1ed81afce9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264540.8991463, cb89325c-680a-4413-8e94-4eddfaa79c6b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:55:40 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully detached device vdb from instance cb89325c-680a-4413-8e94-4eddfaa79c6b from the live domain config.
Apr 12 01:55:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWTrRDKA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:55:40 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:55:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4663ec9-21d0-4ac8-b58c-87a9e9b241aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:55:40 user nova-compute[82184]: No targets found.
Apr 12 01:55:40 user nova-compute[82184]: iSNS:
Apr 12 01:55:40 user nova-compute[82184]: No targets found.
Apr 12 01:55:40 user nova-compute[82184]: STATIC:
Apr 12 01:55:40 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b
Apr 12 01:55:40 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:55:40 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:55:40 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896
Apr 12 01:55:40 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:55:40 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:55:40 user nova-compute[82184]: FIRMWARE:
Apr 12 01:55:40 user nova-compute[82184]: No targets found.
Apr 12 01:55:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:55:40 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:55:40 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d74aec-6d6a-4588-98fa-7564290e2ef5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e886fd9-addd-4f43-aa25-b5803fbb0939]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:55:40 user nova-compute[82184]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)
Apr 12 01:55:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b (non-flash)
Apr 12 01:55:40 user nova-compute[82184]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)
Apr 12 01:55:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a8212b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:55:40 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5012327c-3f1b-45b7-ae1c-e1e4a1dfa028]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1da572-40a6-4234-821d-bd5768b3176d]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf2ca14-d0f4-4e88-abc6-75a4ad9e6c7b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfd0bfe-e7bd-401a-ad3d-09f051e56c33]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9683b5-6d71-4461-9083-01893e678d5b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4550d954-6df6-4939-bffe-d1b3ef7df7ac]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260]
Apr 12 01:55:41 user nova-compute[82184]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b, portal: 172.16.0.220,3260] successful.
Apr 12 01:55:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52725f14-a644-4019-b7c6-9547d83cfb1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61d6a6e-e470-491e-8710-f60e24ca6f71]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== disconnect_volume: return (342ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:55:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG nova.objects.instance [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1cb737ef-08d5-4676-93a2-c192b8a0278c tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.785s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7406615c-882d-486c-9b01-652c2dae7f5d tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7406615c-882d-486c-9b01-652c2dae7f5d tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7406615c-882d-486c-9b01-652c2dae7f5d tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7406615c-882d-486c-9b01-652c2dae7f5d tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82184) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7406615c-882d-486c-9b01-652c2dae7f5d tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-c8a59099-57d6-486f-bdbf-f1201dee2912 req-75ca9e46-4004-4cce-8393-0394aa8c31a7 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-unplugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c8a59099-57d6-486f-bdbf-f1201dee2912 req-75ca9e46-4004-4cce-8393-0394aa8c31a7 service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c8a59099-57d6-486f-bdbf-f1201dee2912 req-75ca9e46-4004-4cce-8393-0394aa8c31a7 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c8a59099-57d6-486f-bdbf-f1201dee2912 req-75ca9e46-4004-4cce-8393-0394aa8c31a7 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-c8a59099-57d6-486f-bdbf-f1201dee2912 req-75ca9e46-4004-4cce-8393-0394aa8c31a7 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-unplugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:43 user nova-compute[82184]: WARNING nova.compute.manager [req-c8a59099-57d6-486f-bdbf-f1201dee2912 req-75ca9e46-4004-4cce-8393-0394aa8c31a7 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-unplugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state active and task_state powering-off.
Apr 12 01:55:43 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance destroyed successfully.
Apr 12 01:55:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7406615c-882d-486c-9b01-652c2dae7f5d tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7406615c-882d-486c-9b01-652c2dae7f5d tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.882s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:55:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG nova.compute.manager [req-54505509-da57-465b-a0e2-24f42750fbb7 req-cf59e572-1bd6-45cf-b917-46b1866cc4b0 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-54505509-da57-465b-a0e2-24f42750fbb7 req-cf59e572-1bd6-45cf-b917-46b1866cc4b0 service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-54505509-da57-465b-a0e2-24f42750fbb7 req-cf59e572-1bd6-45cf-b917-46b1866cc4b0 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-54505509-da57-465b-a0e2-24f42750fbb7 req-cf59e572-1bd6-45cf-b917-46b1866cc4b0 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG nova.compute.manager [req-54505509-da57-465b-a0e2-24f42750fbb7 req-cf59e572-1bd6-45cf-b917-46b1866cc4b0 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:45 user nova-compute[82184]: WARNING nova.compute.manager [req-54505509-da57-465b-a0e2-24f42750fbb7 req-cf59e572-1bd6-45cf-b917-46b1866cc4b0 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state stopped and task_state None.
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:47 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:55:47 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=7931MB free_disk=26.51897430419922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cb89325c-680a-4413-8e94-4eddfaa79c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:55:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:55:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:55:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:55:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Updating instance_info_cache with network_info: [{"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-2dbe5433-e1e5-4b85-a0f7-904c3b784335" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:55:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:57 user nova-compute[82184]: DEBUG nova.compute.manager [req-9da58172-4ea4-4d5f-a968-74529c0f0997 req-cba0ecb0-8495-4914-ba17-f5993e2d18e1 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-changed-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:57 user nova-compute[82184]: DEBUG nova.compute.manager [req-9da58172-4ea4-4d5f-a968-74529c0f0997 req-cba0ecb0-8495-4914-ba17-f5993e2d18e1 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Refreshing instance network info cache due to event network-changed-77c37f41-cbd9-4b96-a5e7-103d187fce32. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:55:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9da58172-4ea4-4d5f-a968-74529c0f0997 req-cba0ecb0-8495-4914-ba17-f5993e2d18e1 service nova] Acquiring lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:55:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9da58172-4ea4-4d5f-a968-74529c0f0997 req-cba0ecb0-8495-4914-ba17-f5993e2d18e1 service nova] Acquired lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:55:57 user nova-compute[82184]: DEBUG nova.network.neutron [req-9da58172-4ea4-4d5f-a968-74529c0f0997 req-cba0ecb0-8495-4914-ba17-f5993e2d18e1 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Refreshing network info cache for port 77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:55:57 user nova-compute[82184]: DEBUG nova.network.neutron [req-9da58172-4ea4-4d5f-a968-74529c0f0997 req-cba0ecb0-8495-4914-ba17-f5993e2d18e1 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updated VIF entry in instance network info cache for port 77c37f41-cbd9-4b96-a5e7-103d187fce32. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:55:57 user nova-compute[82184]: DEBUG nova.network.neutron [req-9da58172-4ea4-4d5f-a968-74529c0f0997 req-cba0ecb0-8495-4914-ba17-f5993e2d18e1 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating instance_info_cache with network_info: [{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:55:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9da58172-4ea4-4d5f-a968-74529c0f0997 req-cba0ecb0-8495-4914-ba17-f5993e2d18e1 service nova] Releasing lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:55:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:55:58 user nova-compute[82184]: INFO nova.compute.manager [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] instance snapshotting
Apr 12 01:55:58 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Beginning live snapshot process
Apr 12 01:55:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json -f qcow2 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json -f qcow2 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:58 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264543.5027273, cb89325c-680a-4413-8e94-4eddfaa79c6b => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:55:58 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] VM Stopped (Lifecycle Event)
Apr 12 01:55:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a320db94-f074-4578-96b9-2111f04c214d None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:55:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a320db94-f074-4578-96b9-2111f04c214d None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:55:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.151s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptvehc9bp/25b4079bb9f0485dbec568fd4f48de7a.delta 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:55:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptvehc9bp/25b4079bb9f0485dbec568fd4f48de7a.delta 1073741824" returned: 0 in 0.050s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:55:58 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 01:55:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:59 user nova-compute[82184]: INFO nova.compute.manager [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Terminating instance
Apr 12 01:55:59 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-14ec423a-5357-438e-938a-bcc082915409 req-207e5d30-a506-4797-93f1-6f11b5ffa669 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received event network-vif-unplugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-14ec423a-5357-438e-938a-bcc082915409 req-207e5d30-a506-4797-93f1-6f11b5ffa669 service nova] Acquiring lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-14ec423a-5357-438e-938a-bcc082915409 req-207e5d30-a506-4797-93f1-6f11b5ffa669 service nova] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-14ec423a-5357-438e-938a-bcc082915409 req-207e5d30-a506-4797-93f1-6f11b5ffa669 service nova] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-14ec423a-5357-438e-938a-bcc082915409 req-207e5d30-a506-4797-93f1-6f11b5ffa669 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] No waiting events found dispatching network-vif-unplugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-14ec423a-5357-438e-938a-bcc082915409 req-207e5d30-a506-4797-93f1-6f11b5ffa669 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received event network-vif-unplugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:55:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 01:56:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 01:56:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Instance destroyed successfully.
Apr 12 01:56:00 user nova-compute[82184]: DEBUG nova.objects.instance [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lazy-loading 'resources' on Instance uuid 2dbe5433-e1e5-4b85-a0f7-904c3b784335 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1833946083',display_name='tempest-VolumesAdminNegativeTest-server-1833946083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1833946083',id=8,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDhtyZheVbYlLeUhN71vEcEpIuCfTBPYbfrrTYkKIj9EYz55uOf6GTaC6L9Qt5AUB8U6/UJe/T4rJ4Zr50Pm9jh0coWiuaA7ovp73w+1OnKciWJB+jFAJEIEOPz+MR+bw==',key_name='tempest-keypair-599771826',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0dd135bd60941dbb68b3e677c4878e9',ramdisk_id='',reservation_id='r-tyw06dt0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-312412096',owner_user_name='tempest-VolumesAdminNegativeTest-312412096-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aeb7fd40946e43dc860d63bb8958d633',uuid=2dbe5433-e1e5-4b85-a0f7-904c3b784335,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converting VIF {"id": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "address": "fa:16:3e:fd:23:a5", "network": {"id": "387dd6cf-c04c-4f01-b526-b70c95a66b22", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1365633533-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0dd135bd60941dbb68b3e677c4878e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0adec2f-3e", "ovs_interfaceid": "f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:23:a5,bridge_name='br-int',has_traffic_filtering=True,id=f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0adec2f-3e') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG os_vif [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:23:a5,bridge_name='br-int',has_traffic_filtering=True,id=f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0adec2f-3e') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0adec2f-3e, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:00 user nova-compute[82184]: INFO os_vif [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:23:a5,bridge_name='br-int',has_traffic_filtering=True,id=f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c,network=Network(387dd6cf-c04c-4f01-b526-b70c95a66b22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0adec2f-3e')
Apr 12 01:56:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Deleting instance files /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335_del
Apr 12 01:56:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Deletion of /opt/stack/data/nova/instances/2dbe5433-e1e5-4b85-a0f7-904c3b784335_del complete
Apr 12 01:56:00 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptvehc9bp/25b4079bb9f0485dbec568fd4f48de7a.delta /opt/stack/data/nova/instances/snapshots/tmptvehc9bp/25b4079bb9f0485dbec568fd4f48de7a {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:00 user nova-compute[82184]: INFO nova.compute.manager [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 01:56:00 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:56:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptvehc9bp/25b4079bb9f0485dbec568fd4f48de7a.delta /opt/stack/data/nova/instances/snapshots/tmptvehc9bp/25b4079bb9f0485dbec568fd4f48de7a" returned: 0 in 0.224s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Snapshot extracted, beginning image upload
Apr 12 01:56:00 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:56:00 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Took 0.71 seconds to deallocate network for instance.
Apr 12 01:56:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.528s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:01 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Deleted allocations for instance 2dbe5433-e1e5-4b85-a0f7-904c3b784335
Apr 12 01:56:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5d8b50f0-5b59-4dbb-9acc-d12257c4e061 tempest-VolumesAdminNegativeTest-312412096 tempest-VolumesAdminNegativeTest-312412096-project-member] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-7fb1309b-4a91-490f-8289-f1ee4aa70ab4 req-bb835895-6f71-4dc8-ac75-bc4f10817105 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received event network-vif-plugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7fb1309b-4a91-490f-8289-f1ee4aa70ab4 req-bb835895-6f71-4dc8-ac75-bc4f10817105 service nova] Acquiring lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7fb1309b-4a91-490f-8289-f1ee4aa70ab4 req-bb835895-6f71-4dc8-ac75-bc4f10817105 service nova] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7fb1309b-4a91-490f-8289-f1ee4aa70ab4 req-bb835895-6f71-4dc8-ac75-bc4f10817105 service nova] Lock "2dbe5433-e1e5-4b85-a0f7-904c3b784335-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-7fb1309b-4a91-490f-8289-f1ee4aa70ab4 req-bb835895-6f71-4dc8-ac75-bc4f10817105 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] No waiting events found dispatching network-vif-plugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:56:01 user nova-compute[82184]: WARNING nova.compute.manager [req-7fb1309b-4a91-490f-8289-f1ee4aa70ab4 req-bb835895-6f71-4dc8-ac75-bc4f10817105 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received unexpected event network-vif-plugged-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c for instance with vm_state deleted and task_state None.
Apr 12 01:56:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-7fb1309b-4a91-490f-8289-f1ee4aa70ab4 req-bb835895-6f71-4dc8-ac75-bc4f10817105 service nova] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Received event network-vif-deleted-f0adec2f-3ed3-4b7d-b435-a24c75b4cb2c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:02 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Snapshot image upload complete
Apr 12 01:56:02 user nova-compute[82184]: INFO nova.compute.manager [None req-f6f66ecb-336f-4756-b926-0c7c238b6c8d tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Took 4.59 seconds to snapshot the instance on the hypervisor.
Apr 12 01:56:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "39c1ed52-fe5b-4e57-854a-36476bdb215c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:56:13 user nova-compute[82184]: INFO nova.compute.claims [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Claim successful on node user
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:56:13 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.policy [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d876b30b1724669a8d7e8bd543fa18c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce361b6fa374bca8dc0a48a53ad54f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:56:13 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Creating image(s)
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "/opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "/opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "/opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk 1073741824" returned: 0 in 0.048s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:56:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Cannot resize image /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lazy-loading 'migration_context' on Instance uuid 39c1ed52-fe5b-4e57-854a-36476bdb215c {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Ensure instance console log exists: /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Successfully created port: 4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Successfully updated port: 4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "refresh_cache-39c1ed52-fe5b-4e57-854a-36476bdb215c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquired lock "refresh_cache-39c1ed52-fe5b-4e57-854a-36476bdb215c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-fb3f45f1-f5e1-4e2c-b636-74c0bb82ff6a req-f29391a6-455a-4fc9-9805-a17aeace012d service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Received event network-changed-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-fb3f45f1-f5e1-4e2c-b636-74c0bb82ff6a req-f29391a6-455a-4fc9-9805-a17aeace012d service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Refreshing instance network info cache due to event network-changed-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fb3f45f1-f5e1-4e2c-b636-74c0bb82ff6a req-f29391a6-455a-4fc9-9805-a17aeace012d service nova] Acquiring lock "refresh_cache-39c1ed52-fe5b-4e57-854a-36476bdb215c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:56:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264560.1468806, 2dbe5433-e1e5-4b85-a0f7-904c3b784335 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:56:15 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] VM Stopped (Lifecycle Event)
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cb907272-f592-4016-9e3d-389da0748dfb None None] [instance: 2dbe5433-e1e5-4b85-a0f7-904c3b784335] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Updating instance_info_cache with network_info: [{"id": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "address": "fa:16:3e:f1:95:9f", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adf6f7b-2c", "ovs_interfaceid": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Releasing lock "refresh_cache-39c1ed52-fe5b-4e57-854a-36476bdb215c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Instance network_info: |[{"id": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "address": "fa:16:3e:f1:95:9f", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adf6f7b-2c", "ovs_interfaceid": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fb3f45f1-f5e1-4e2c-b636-74c0bb82ff6a req-f29391a6-455a-4fc9-9805-a17aeace012d service nova] Acquired lock "refresh_cache-39c1ed52-fe5b-4e57-854a-36476bdb215c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-fb3f45f1-f5e1-4e2c-b636-74c0bb82ff6a req-f29391a6-455a-4fc9-9805-a17aeace012d service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Refreshing network info cache for port 4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Start _get_guest_xml network_info=[{"id": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "address": "fa:16:3e:f1:95:9f", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adf6f7b-2c", "ovs_interfaceid": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:56:15 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:56:15 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1665338189',display_name='tempest-VolumesActionsTest-instance-1665338189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1665338189',id=18,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce361b6fa374bca8dc0a48a53ad54f9',ramdisk_id='',reservation_id='r-y66qrqwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-89585441',owner_user_name='tempest-VolumesActionsTest-89585441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:56:13Z,user_data=None,user_id='4d876b30b1724669a8d7e8bd543fa18c',uuid=39c1ed52-fe5b-4e57-854a-36476bdb215c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "address": "fa:16:3e:f1:95:9f", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adf6f7b-2c", "ovs_interfaceid": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converting VIF {"id": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "address": "fa:16:3e:f1:95:9f", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adf6f7b-2c", "ovs_interfaceid": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:95:9f,bridge_name='br-int',has_traffic_filtering=True,id=4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adf6f7b-2c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lazy-loading 'pci_devices' on Instance uuid 39c1ed52-fe5b-4e57-854a-36476bdb215c {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:56:15 user nova-compute[82184]:   <uuid>39c1ed52-fe5b-4e57-854a-36476bdb215c</uuid>
Apr 12 01:56:15 user nova-compute[82184]:   <name>instance-00000012</name>
Apr 12 01:56:15 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:56:15 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:56:15 user nova-compute[82184]:   <metadata>
Apr 12 01:56:15 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:56:15 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:56:15 user nova-compute[82184]:       <nova:name>tempest-VolumesActionsTest-instance-1665338189</nova:name>
Apr 12 01:56:15 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:56:15</nova:creationTime>
Apr 12 01:56:15 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:56:15 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:56:15 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:56:15 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:56:15 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:56:15 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:56:15 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:56:15 user nova-compute[82184]:       <nova:owner>
Apr 12 01:56:15 user nova-compute[82184]:         <nova:user uuid="4d876b30b1724669a8d7e8bd543fa18c">tempest-VolumesActionsTest-89585441-project-member</nova:user>
Apr 12 01:56:15 user nova-compute[82184]:         <nova:project uuid="3ce361b6fa374bca8dc0a48a53ad54f9">tempest-VolumesActionsTest-89585441</nova:project>
Apr 12 01:56:15 user nova-compute[82184]:       </nova:owner>
Apr 12 01:56:15 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:56:15 user nova-compute[82184]:       <nova:ports>
Apr 12 01:56:15 user nova-compute[82184]:         <nova:port uuid="4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec">
Apr 12 01:56:15 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 01:56:15 user nova-compute[82184]:         </nova:port>
Apr 12 01:56:15 user nova-compute[82184]:       </nova:ports>
Apr 12 01:56:15 user nova-compute[82184]:     </nova:instance>
Apr 12 01:56:15 user nova-compute[82184]:   </metadata>
Apr 12 01:56:15 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:56:15 user nova-compute[82184]:     <system>
Apr 12 01:56:15 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:56:15 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:56:15 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:56:15 user nova-compute[82184]:       <entry name="serial">39c1ed52-fe5b-4e57-854a-36476bdb215c</entry>
Apr 12 01:56:15 user nova-compute[82184]:       <entry name="uuid">39c1ed52-fe5b-4e57-854a-36476bdb215c</entry>
Apr 12 01:56:15 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:56:15 user nova-compute[82184]:     </system>
Apr 12 01:56:15 user nova-compute[82184]:   </sysinfo>
Apr 12 01:56:15 user nova-compute[82184]:   <os>
Apr 12 01:56:15 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:56:15 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:56:15 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:56:15 user nova-compute[82184]:   </os>
Apr 12 01:56:15 user nova-compute[82184]:   <features>
Apr 12 01:56:15 user nova-compute[82184]:     <acpi/>
Apr 12 01:56:15 user nova-compute[82184]:     <apic/>
Apr 12 01:56:15 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:56:15 user nova-compute[82184]:   </features>
Apr 12 01:56:15 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:56:15 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:56:15 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:56:15 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:56:15 user nova-compute[82184]:   </clock>
Apr 12 01:56:15 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:56:15 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:56:15 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:56:15 user nova-compute[82184]:   </cpu>
Apr 12 01:56:15 user nova-compute[82184]:   <devices>
Apr 12 01:56:15 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:56:15 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:56:15 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk"/>
Apr 12 01:56:15 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:56:15 user nova-compute[82184]:     </disk>
Apr 12 01:56:15 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:56:15 user nova-compute[82184]:       <mac address="fa:16:3e:f1:95:9f"/>
Apr 12 01:56:15 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:56:15 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:56:15 user nova-compute[82184]:       <target dev="tap4adf6f7b-2c"/>
Apr 12 01:56:15 user nova-compute[82184]:     </interface>
Apr 12 01:56:15 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:56:15 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/console.log" append="off"/>
Apr 12 01:56:15 user nova-compute[82184]:     </serial>
Apr 12 01:56:15 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:56:15 user nova-compute[82184]:     <video>
Apr 12 01:56:15 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:56:15 user nova-compute[82184]:     </video>
Apr 12 01:56:15 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:56:15 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:56:15 user nova-compute[82184]:     </rng>
Apr 12 01:56:15 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:56:15 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:56:15 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:56:15 user nova-compute[82184]:     </memballoon>
Apr 12 01:56:15 user nova-compute[82184]:   </devices>
Apr 12 01:56:15 user nova-compute[82184]: </domain>
Apr 12 01:56:15 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1665338189',display_name='tempest-VolumesActionsTest-instance-1665338189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1665338189',id=18,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce361b6fa374bca8dc0a48a53ad54f9',ramdisk_id='',reservation_id='r-y66qrqwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-89585441',owner_user_name='tempest-VolumesActionsTest-89585441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:56:13Z,user_data=None,user_id='4d876b30b1724669a8d7e8bd543fa18c',uuid=39c1ed52-fe5b-4e57-854a-36476bdb215c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "address": "fa:16:3e:f1:95:9f", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adf6f7b-2c", "ovs_interfaceid": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converting VIF {"id": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "address": "fa:16:3e:f1:95:9f", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adf6f7b-2c", "ovs_interfaceid": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:95:9f,bridge_name='br-int',has_traffic_filtering=True,id=4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adf6f7b-2c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG os_vif [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:95:9f,bridge_name='br-int',has_traffic_filtering=True,id=4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adf6f7b-2c') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4adf6f7b-2c, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4adf6f7b-2c, col_values=(('external_ids', {'iface-id': '4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:95:9f', 'vm-uuid': '39c1ed52-fe5b-4e57-854a-36476bdb215c'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:15 user nova-compute[82184]: INFO os_vif [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:95:9f,bridge_name='br-int',has_traffic_filtering=True,id=4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adf6f7b-2c')
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] No VIF found with MAC fa:16:3e:f1:95:9f, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-fb3f45f1-f5e1-4e2c-b636-74c0bb82ff6a req-f29391a6-455a-4fc9-9805-a17aeace012d service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Updated VIF entry in instance network info cache for port 4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-fb3f45f1-f5e1-4e2c-b636-74c0bb82ff6a req-f29391a6-455a-4fc9-9805-a17aeace012d service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Updating instance_info_cache with network_info: [{"id": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "address": "fa:16:3e:f1:95:9f", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adf6f7b-2c", "ovs_interfaceid": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:56:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fb3f45f1-f5e1-4e2c-b636-74c0bb82ff6a req-f29391a6-455a-4fc9-9805-a17aeace012d service nova] Releasing lock "refresh_cache-39c1ed52-fe5b-4e57-854a-36476bdb215c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:56:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-c6604adf-919f-407d-adc7-59d2137f5ee5 req-5350795f-f7bb-4117-91e3-42921391664b service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Received event network-vif-plugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6604adf-919f-407d-adc7-59d2137f5ee5 req-5350795f-f7bb-4117-91e3-42921391664b service nova] Acquiring lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6604adf-919f-407d-adc7-59d2137f5ee5 req-5350795f-f7bb-4117-91e3-42921391664b service nova] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6604adf-919f-407d-adc7-59d2137f5ee5 req-5350795f-f7bb-4117-91e3-42921391664b service nova] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-c6604adf-919f-407d-adc7-59d2137f5ee5 req-5350795f-f7bb-4117-91e3-42921391664b service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] No waiting events found dispatching network-vif-plugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:56:16 user nova-compute[82184]: WARNING nova.compute.manager [req-c6604adf-919f-407d-adc7-59d2137f5ee5 req-5350795f-f7bb-4117-91e3-42921391664b service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Received unexpected event network-vif-plugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec for instance with vm_state building and task_state spawning.
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264578.7782753, 39c1ed52-fe5b-4e57-854a-36476bdb215c => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:56:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] VM Resumed (Lifecycle Event)
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:56:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Instance spawned successfully.
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:56:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264578.7809236, 39c1ed52-fe5b-4e57-854a-36476bdb215c => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:56:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] VM Started (Lifecycle Event)
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:56:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:56:18 user nova-compute[82184]: INFO nova.compute.manager [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Took 5.38 seconds to spawn the instance on the hypervisor.
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b494ae-6906-4979-816a-b99e97c57575 req-750b0506-f873-44cd-aad1-ac682ac41df5 service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Received event network-vif-plugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b494ae-6906-4979-816a-b99e97c57575 req-750b0506-f873-44cd-aad1-ac682ac41df5 service nova] Acquiring lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b494ae-6906-4979-816a-b99e97c57575 req-750b0506-f873-44cd-aad1-ac682ac41df5 service nova] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b494ae-6906-4979-816a-b99e97c57575 req-750b0506-f873-44cd-aad1-ac682ac41df5 service nova] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b494ae-6906-4979-816a-b99e97c57575 req-750b0506-f873-44cd-aad1-ac682ac41df5 service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] No waiting events found dispatching network-vif-plugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:56:18 user nova-compute[82184]: WARNING nova.compute.manager [req-b6b494ae-6906-4979-816a-b99e97c57575 req-750b0506-f873-44cd-aad1-ac682ac41df5 service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Received unexpected event network-vif-plugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec for instance with vm_state building and task_state spawning.
Apr 12 01:56:18 user nova-compute[82184]: INFO nova.compute.manager [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Took 6.00 seconds to build instance.
Apr 12 01:56:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6ee88c0d-4cbd-4ca3-b669-7d20484791db tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.088s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:24 user nova-compute[82184]: INFO nova.compute.manager [None req-b2ccaae9-b0da-4ea4-bc93-61526f45ce68 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Unrescuing
Apr 12 01:56:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b2ccaae9-b0da-4ea4-bc93-61526f45ce68 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:56:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b2ccaae9-b0da-4ea4-bc93-61526f45ce68 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquired lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:56:24 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b2ccaae9-b0da-4ea4-bc93-61526f45ce68 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b2ccaae9-b0da-4ea4-bc93-61526f45ce68 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updating instance_info_cache with network_info: [{"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b2ccaae9-b0da-4ea4-bc93-61526f45ce68 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Releasing lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b2ccaae9-b0da-4ea4-bc93-61526f45ce68 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'flavor' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-44ad3bfd-4ec8-41cb-88d1-b591012bc4d0 req-4a412f0a-6b92-4914-ad60-532eba4b9261 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-unplugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-44ad3bfd-4ec8-41cb-88d1-b591012bc4d0 req-4a412f0a-6b92-4914-ad60-532eba4b9261 service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-44ad3bfd-4ec8-41cb-88d1-b591012bc4d0 req-4a412f0a-6b92-4914-ad60-532eba4b9261 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-44ad3bfd-4ec8-41cb-88d1-b591012bc4d0 req-4a412f0a-6b92-4914-ad60-532eba4b9261 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-44ad3bfd-4ec8-41cb-88d1-b591012bc4d0 req-4a412f0a-6b92-4914-ad60-532eba4b9261 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-unplugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:56:25 user nova-compute[82184]: WARNING nova.compute.manager [req-44ad3bfd-4ec8-41cb-88d1-b591012bc4d0 req-4a412f0a-6b92-4914-ad60-532eba4b9261 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-unplugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:56:25 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Instance destroyed successfully.
Apr 12 01:56:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 39c1ed52-fe5b-4e57-854a-36476bdb215c {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:27 user nova-compute[82184]: INFO nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "c712f2db-72cb-4136-a719-56057d82fff6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "39c1ed52-fe5b-4e57-854a-36476bdb215c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "c712f2db-72cb-4136-a719-56057d82fff6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:56:27 user nova-compute[82184]: WARNING nova.compute.manager [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:56:27 user nova-compute[82184]: WARNING nova.compute.manager [req-21a78c1f-ad34-4992-9249-901d93e2df47 req-2849389f-56b5-4b6b-8760-a208a5308912 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:56:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for fdbd8add-ac0e-42ce-9b34-5878c6bec208 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 01:56:29 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264589.448316, fdbd8add-ac0e-42ce-9b34-5878c6bec208 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:56:29 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] VM Resumed (Lifecycle Event)
Apr 12 01:56:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b2ccaae9-b0da-4ea4-bc93-61526f45ce68 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:56:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:56:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:56:29 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 01:56:29 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264589.4498274, fdbd8add-ac0e-42ce-9b34-5878c6bec208 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:56:29 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] VM Started (Lifecycle Event)
Apr 12 01:56:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:56:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:56:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-deea4b83-6a15-4b76-af7d-b3689eba02c3 req-689e62d5-eef6-49b8-877b-c7982919b482 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-deea4b83-6a15-4b76-af7d-b3689eba02c3 req-689e62d5-eef6-49b8-877b-c7982919b482 service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-deea4b83-6a15-4b76-af7d-b3689eba02c3 req-689e62d5-eef6-49b8-877b-c7982919b482 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-deea4b83-6a15-4b76-af7d-b3689eba02c3 req-689e62d5-eef6-49b8-877b-c7982919b482 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-deea4b83-6a15-4b76-af7d-b3689eba02c3 req-689e62d5-eef6-49b8-877b-c7982919b482 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:56:29 user nova-compute[82184]: WARNING nova.compute.manager [req-deea4b83-6a15-4b76-af7d-b3689eba02c3 req-689e62d5-eef6-49b8-877b-c7982919b482 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state active and task_state None.
Apr 12 01:56:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:34 user nova-compute[82184]: INFO nova.compute.manager [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Detaching volume 333bfdb2-c5a0-443a-bcc1-c203e669c896
Apr 12 01:56:35 user nova-compute[82184]: INFO nova.virt.block_device [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attempting to driver detach volume 333bfdb2-c5a0-443a-bcc1-c203e669c896 from mountpoint /dev/vdb
Apr 12 01:56:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Attempting to detach device vdb from instance c712f2db-72cb-4136-a719-56057d82fff6 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:56:35 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:56:35 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 01:56:35 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:56:35 user nova-compute[82184]:   <serial>333bfdb2-c5a0-443a-bcc1-c203e669c896</serial>
Apr 12 01:56:35 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 01:56:35 user nova-compute[82184]: </disk>
Apr 12 01:56:35 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:56:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully detached device vdb from instance c712f2db-72cb-4136-a719-56057d82fff6 from the persistent domain config.
Apr 12 01:56:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c712f2db-72cb-4136-a719-56057d82fff6 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:56:35 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:56:35 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 01:56:35 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:56:35 user nova-compute[82184]:   <serial>333bfdb2-c5a0-443a-bcc1-c203e669c896</serial>
Apr 12 01:56:35 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 01:56:35 user nova-compute[82184]: </disk>
Apr 12 01:56:35 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264595.5552492, c712f2db-72cb-4136-a719-56057d82fff6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:56:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully detached device vdb from instance c712f2db-72cb-4136-a719-56057d82fff6 from the live domain config.
Apr 12 01:56:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hHlJjRpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:56:35 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bf0de4-375d-41b2-afc5-6f9940c71332]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:56:35 user nova-compute[82184]: No targets found.
Apr 12 01:56:35 user nova-compute[82184]: iSNS:
Apr 12 01:56:35 user nova-compute[82184]: No targets found.
Apr 12 01:56:35 user nova-compute[82184]: STATIC:
Apr 12 01:56:35 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896
Apr 12 01:56:35 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:56:35 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:56:35 user nova-compute[82184]: FIRMWARE:
Apr 12 01:56:35 user nova-compute[82184]: No targets found.
Apr 12 01:56:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:56:35 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:56:35 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[355e444c-4a4f-4cf4-a3a3-e6497be3257e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[21209856-4716-4143-a509-6dc3f1420a5e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)
Apr 12 01:56:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 (non-flash)
Apr 12 01:56:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a856ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896'): ({'sdc'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Removing single pathed devices sdc {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe01286-5bec-4b1c-9dda-b544dd5e6f11]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd498c71-0e65-446a-a364-7d7b7edcf945]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flushing IO for device /dev/sdc {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b91515a-208c-4783-b699-37cf2f72b229]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b64d22-9c53-4cea-abac-323f18ca85c4]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2fe4af-7260-417b-992b-46b3ea5f347f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c348a54-bd5d-485f-89d0-6827b0053bb8]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260]
Apr 12 01:56:35 user nova-compute[82184]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896, portal: 172.16.0.220,3260] successful.
Apr 12 01:56:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333bfdb2-c5a0-443a-bcc1-c203e669c896 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aba9646-8468-4548-913a-d6a42d7748b5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== disconnect_volume: return (309ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:56:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:56:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'flavor' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:56:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-78f59ee2-f0b2-44d5-ae4e-eb080f642470 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.092s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:56:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:43 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:56:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:47 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:56:47 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8021MB free_disk=26.49869155883789GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cb89325c-680a-4413-8e94-4eddfaa79c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 39c1ed52-fe5b-4e57-854a-36476bdb215c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:56:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:56:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:56:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-f1012d4c-e1ba-48aa-8a2b-af01ea07661b req-38b73126-7c1c-45af-8027-423c2e472c13 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-changed-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-f1012d4c-e1ba-48aa-8a2b-af01ea07661b req-38b73126-7c1c-45af-8027-423c2e472c13 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Refreshing instance network info cache due to event network-changed-0e649e0b-d93b-473c-a765-b0173cea1a6d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:56:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f1012d4c-e1ba-48aa-8a2b-af01ea07661b req-38b73126-7c1c-45af-8027-423c2e472c13 service nova] Acquiring lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:56:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f1012d4c-e1ba-48aa-8a2b-af01ea07661b req-38b73126-7c1c-45af-8027-423c2e472c13 service nova] Acquired lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:56:52 user nova-compute[82184]: DEBUG nova.network.neutron [req-f1012d4c-e1ba-48aa-8a2b-af01ea07661b req-38b73126-7c1c-45af-8027-423c2e472c13 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Refreshing network info cache for port 0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:56:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "interface-5b7cbacb-f776-4e9a-b333-ce9c345dc525-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "interface-5b7cbacb-f776-4e9a-b333-ce9c345dc525-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:53 user nova-compute[82184]: DEBUG nova.objects.instance [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lazy-loading 'flavor' on Instance uuid 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:56:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:53 user nova-compute[82184]: DEBUG nova.objects.instance [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lazy-loading 'pci_requests' on Instance uuid 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:56:53 user nova-compute[82184]: DEBUG nova.network.neutron [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:56:53 user nova-compute[82184]: DEBUG nova.policy [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43819af3565d4eff92ce1a51f86df4f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3443faad6b314920a85b8491603e30ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:56:53 user nova-compute[82184]: DEBUG nova.network.neutron [req-f1012d4c-e1ba-48aa-8a2b-af01ea07661b req-38b73126-7c1c-45af-8027-423c2e472c13 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updated VIF entry in instance network info cache for port 0e649e0b-d93b-473c-a765-b0173cea1a6d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:56:53 user nova-compute[82184]: DEBUG nova.network.neutron [req-f1012d4c-e1ba-48aa-8a2b-af01ea07661b req-38b73126-7c1c-45af-8027-423c2e472c13 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updating instance_info_cache with network_info: [{"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:56:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f1012d4c-e1ba-48aa-8a2b-af01ea07661b req-38b73126-7c1c-45af-8027-423c2e472c13 service nova] Releasing lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:56:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Successfully created port: bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:56:55 user nova-compute[82184]: DEBUG nova.network.neutron [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Successfully updated port: bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:56:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:56:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquired lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:56:55 user nova-compute[82184]: DEBUG nova.network.neutron [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:56:55 user nova-compute[82184]: DEBUG nova.compute.manager [req-682d0627-499a-4ae4-9217-1c1c26409596 req-ce3d5fc1-5899-4e25-aa03-79113aa2bb9d service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-changed-bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:55 user nova-compute[82184]: DEBUG nova.compute.manager [req-682d0627-499a-4ae4-9217-1c1c26409596 req-ce3d5fc1-5899-4e25-aa03-79113aa2bb9d service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Refreshing instance network info cache due to event network-changed-bb6652b3-90cf-4337-a94b-ca982c4397f5. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:56:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-682d0627-499a-4ae4-9217-1c1c26409596 req-ce3d5fc1-5899-4e25-aa03-79113aa2bb9d service nova] Acquiring lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:56:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updating instance_info_cache with network_info: [{"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "address": "fa:16:3e:7a:8a:36", "network": {"id": "2dceb67c-b24a-4d04-b054-93f03677d195", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-630581707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6652b3-90", "ovs_interfaceid": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Releasing lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-682d0627-499a-4ae4-9217-1c1c26409596 req-ce3d5fc1-5899-4e25-aa03-79113aa2bb9d service nova] Acquired lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.network.neutron [req-682d0627-499a-4ae4-9217-1c1c26409596 req-ce3d5fc1-5899-4e25-aa03-79113aa2bb9d service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Refreshing network info cache for port bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211209472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-211209472',id=17,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlxYLGiDT3ULykrJ/16FAYLe9mlS7WpoHsNkE+Oww0i5S0/0HEU1ZMf1BlJ8O7u24iaXO1qwL8Qcg5/TeN5uRr2keoVwu2xaLtJctivU4Ipg77M6FqVNyx8y2JxOGS9rQ==',key_name='tempest-keypair-1476535441',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:55:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3443faad6b314920a85b8491603e30ac',ramdisk_id='',reservation_id='r-jpcow580',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1804071739',owner_user_name='tempest-TaggedAttachmentsTest-1804071739-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43819af3565d4eff92ce1a51f86df4f2',uuid=5b7cbacb-f776-4e9a-b333-ce9c345dc525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "address": "fa:16:3e:7a:8a:36", "network": {"id": "2dceb67c-b24a-4d04-b054-93f03677d195", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-630581707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6652b3-90", "ovs_interfaceid": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converting VIF {"id": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "address": "fa:16:3e:7a:8a:36", "network": {"id": "2dceb67c-b24a-4d04-b054-93f03677d195", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-630581707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6652b3-90", "ovs_interfaceid": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:36,bridge_name='br-int',has_traffic_filtering=True,id=bb6652b3-90cf-4337-a94b-ca982c4397f5,network=Network(2dceb67c-b24a-4d04-b054-93f03677d195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6652b3-90') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG os_vif [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:36,bridge_name='br-int',has_traffic_filtering=True,id=bb6652b3-90cf-4337-a94b-ca982c4397f5,network=Network(2dceb67c-b24a-4d04-b054-93f03677d195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6652b3-90') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb6652b3-90, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb6652b3-90, col_values=(('external_ids', {'iface-id': 'bb6652b3-90cf-4337-a94b-ca982c4397f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:8a:36', 'vm-uuid': '5b7cbacb-f776-4e9a-b333-ce9c345dc525'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: INFO os_vif [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:36,bridge_name='br-int',has_traffic_filtering=True,id=bb6652b3-90cf-4337-a94b-ca982c4397f5,network=Network(2dceb67c-b24a-4d04-b054-93f03677d195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6652b3-90')
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211209472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-211209472',id=17,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlxYLGiDT3ULykrJ/16FAYLe9mlS7WpoHsNkE+Oww0i5S0/0HEU1ZMf1BlJ8O7u24iaXO1qwL8Qcg5/TeN5uRr2keoVwu2xaLtJctivU4Ipg77M6FqVNyx8y2JxOGS9rQ==',key_name='tempest-keypair-1476535441',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:55:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3443faad6b314920a85b8491603e30ac',ramdisk_id='',reservation_id='r-jpcow580',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1804071739',owner_user_name='tempest-TaggedAttachmentsTest-1804071739-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43819af3565d4eff92ce1a51f86df4f2',uuid=5b7cbacb-f776-4e9a-b333-ce9c345dc525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "address": "fa:16:3e:7a:8a:36", "network": {"id": "2dceb67c-b24a-4d04-b054-93f03677d195", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-630581707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6652b3-90", "ovs_interfaceid": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converting VIF {"id": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "address": "fa:16:3e:7a:8a:36", "network": {"id": "2dceb67c-b24a-4d04-b054-93f03677d195", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-630581707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6652b3-90", "ovs_interfaceid": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:36,bridge_name='br-int',has_traffic_filtering=True,id=bb6652b3-90cf-4337-a94b-ca982c4397f5,network=Network(2dceb67c-b24a-4d04-b054-93f03677d195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6652b3-90') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] attach device xml: <interface type="ethernet">
Apr 12 01:56:56 user nova-compute[82184]:   <mac address="fa:16:3e:7a:8a:36"/>
Apr 12 01:56:56 user nova-compute[82184]:   <model type="virtio"/>
Apr 12 01:56:56 user nova-compute[82184]:   <mtu size="1442"/>
Apr 12 01:56:56 user nova-compute[82184]:   <target dev="tapbb6652b3-90"/>
Apr 12 01:56:56 user nova-compute[82184]: </interface>
Apr 12 01:56:56 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] No BDM found with device name hda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] No VIF found with MAC fa:16:3e:11:a5:b3, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:56:56 user nova-compute[82184]:   <nova:package version="0.0.0"/>
Apr 12 01:56:56 user nova-compute[82184]:   <nova:name>tempest-device-tagging-server-211209472</nova:name>
Apr 12 01:56:56 user nova-compute[82184]:   <nova:creationTime>2023-04-12 01:56:56</nova:creationTime>
Apr 12 01:56:56 user nova-compute[82184]:   <nova:flavor name="m1.nano">
Apr 12 01:56:56 user nova-compute[82184]:     <nova:memory>128</nova:memory>
Apr 12 01:56:56 user nova-compute[82184]:     <nova:disk>1</nova:disk>
Apr 12 01:56:56 user nova-compute[82184]:     <nova:swap>0</nova:swap>
Apr 12 01:56:56 user nova-compute[82184]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:56:56 user nova-compute[82184]:     <nova:vcpus>1</nova:vcpus>
Apr 12 01:56:56 user nova-compute[82184]:   </nova:flavor>
Apr 12 01:56:56 user nova-compute[82184]:   <nova:owner>
Apr 12 01:56:56 user nova-compute[82184]:     <nova:user uuid="43819af3565d4eff92ce1a51f86df4f2">tempest-TaggedAttachmentsTest-1804071739-project-member</nova:user>
Apr 12 01:56:56 user nova-compute[82184]:     <nova:project uuid="3443faad6b314920a85b8491603e30ac">tempest-TaggedAttachmentsTest-1804071739</nova:project>
Apr 12 01:56:56 user nova-compute[82184]:   </nova:owner>
Apr 12 01:56:56 user nova-compute[82184]:   <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:56:56 user nova-compute[82184]:   <nova:ports>
Apr 12 01:56:56 user nova-compute[82184]:     <nova:port uuid="0e649e0b-d93b-473c-a765-b0173cea1a6d">
Apr 12 01:56:56 user nova-compute[82184]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 01:56:56 user nova-compute[82184]:     </nova:port>
Apr 12 01:56:56 user nova-compute[82184]:     <nova:port uuid="bb6652b3-90cf-4337-a94b-ca982c4397f5">
Apr 12 01:56:56 user nova-compute[82184]:       <nova:ip type="fixed" address="10.10.10.50" ipVersion="4"/>
Apr 12 01:56:56 user nova-compute[82184]:     </nova:port>
Apr 12 01:56:56 user nova-compute[82184]:   </nova:ports>
Apr 12 01:56:56 user nova-compute[82184]: </nova:instance>
Apr 12 01:56:56 user nova-compute[82184]:  {{(pid=82184) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-49183713-33e2-465c-abae-dfebcddce082 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "interface-5b7cbacb-f776-4e9a-b333-ce9c345dc525-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.533s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.network.neutron [req-682d0627-499a-4ae4-9217-1c1c26409596 req-ce3d5fc1-5899-4e25-aa03-79113aa2bb9d service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updated VIF entry in instance network info cache for port bb6652b3-90cf-4337-a94b-ca982c4397f5. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.network.neutron [req-682d0627-499a-4ae4-9217-1c1c26409596 req-ce3d5fc1-5899-4e25-aa03-79113aa2bb9d service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updating instance_info_cache with network_info: [{"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "address": "fa:16:3e:7a:8a:36", "network": {"id": "2dceb67c-b24a-4d04-b054-93f03677d195", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-630581707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6652b3-90", "ovs_interfaceid": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-682d0627-499a-4ae4-9217-1c1c26409596 req-ce3d5fc1-5899-4e25-aa03-79113aa2bb9d service nova] Releasing lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG nova.objects.instance [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lazy-loading 'flavor' on Instance uuid 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:56:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:57 user nova-compute[82184]: INFO nova.compute.manager [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Attaching volume 0b915cc2-ce61-4b9d-832d-412e056f70ad to /dev/vdb
Apr 12 01:56:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG os_brick.utils [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a222e6-a52a-447f-8fd3-4f6bcf45ef2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce71e86f-415e-4248-8579-9dbec47fb28f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a80176b-4f06-4f05-9529-5ab4fb18aaa1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b1792d-7d55-4aeb-ac95-0a7a76f7ee53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:56:57 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb283d3a-608f-4824-91c6-fd07a7bfed2a]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG os_brick.utils [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updating existing volume attachment record: 504a1c75-f07d-4cf7-a91a-3e254975cf32 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG nova.compute.manager [req-022be81f-4bb5-4eb4-a152-f0e612d6b16f req-67e1cb56-b8be-4caa-b696-9ddf5e2b180a service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-plugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-022be81f-4bb5-4eb4-a152-f0e612d6b16f req-67e1cb56-b8be-4caa-b696-9ddf5e2b180a service nova] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-022be81f-4bb5-4eb4-a152-f0e612d6b16f req-67e1cb56-b8be-4caa-b696-9ddf5e2b180a service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-022be81f-4bb5-4eb4-a152-f0e612d6b16f req-67e1cb56-b8be-4caa-b696-9ddf5e2b180a service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:57 user nova-compute[82184]: DEBUG nova.compute.manager [req-022be81f-4bb5-4eb4-a152-f0e612d6b16f req-67e1cb56-b8be-4caa-b696-9ddf5e2b180a service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] No waiting events found dispatching network-vif-plugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:56:57 user nova-compute[82184]: WARNING nova.compute.manager [req-022be81f-4bb5-4eb4-a152-f0e612d6b16f req-67e1cb56-b8be-4caa-b696-9ddf5e2b180a service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received unexpected event network-vif-plugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 for instance with vm_state active and task_state None.
Apr 12 01:56:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Acquiring lock "3827c534-7f4a-4f22-bf88-91e8897c6285" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:56:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:56:58 user nova-compute[82184]: INFO nova.compute.claims [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Claim successful on node user
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.compute.manager [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.compute.manager [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:56:59 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.compute.manager [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.policy [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac9601d0624f4a19863473f6b14f2bf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd34c505d1bc40a394bfbd2ae2edd9fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.compute.manager [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:56:59 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Creating image(s)
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Acquiring lock "/opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "/opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "/opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.150s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.160s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-aaf3562f-2a46-4a2e-9cde-ced64a260fba req-bd30690e-37a9-42a0-a3ad-ef54d1ef7b14 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-plugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aaf3562f-2a46-4a2e-9cde-ced64a260fba req-bd30690e-37a9-42a0-a3ad-ef54d1ef7b14 service nova] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aaf3562f-2a46-4a2e-9cde-ced64a260fba req-bd30690e-37a9-42a0-a3ad-ef54d1ef7b14 service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aaf3562f-2a46-4a2e-9cde-ced64a260fba req-bd30690e-37a9-42a0-a3ad-ef54d1ef7b14 service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:56:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-aaf3562f-2a46-4a2e-9cde-ced64a260fba req-bd30690e-37a9-42a0-a3ad-ef54d1ef7b14 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] No waiting events found dispatching network-vif-plugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:56:59 user nova-compute[82184]: WARNING nova.compute.manager [req-aaf3562f-2a46-4a2e-9cde-ced64a260fba req-bd30690e-37a9-42a0-a3ad-ef54d1ef7b14 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received unexpected event network-vif-plugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 for instance with vm_state active and task_state None.
Apr 12 01:56:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk 1073741824" returned: 0 in 0.055s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Cannot resize image /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG nova.objects.instance [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lazy-loading 'migration_context' on Instance uuid 3827c534-7f4a-4f22-bf88-91e8897c6285 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Ensure instance console log exists: /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:00 user nova-compute[82184]: DEBUG nova.network.neutron [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Successfully created port: b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Successfully updated port: b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Acquiring lock "refresh_cache-3827c534-7f4a-4f22-bf88-91e8897c6285" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Acquired lock "refresh_cache-3827c534-7f4a-4f22-bf88-91e8897c6285" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Updating instance_info_cache with network_info: [{"id": "b0d250e6-f783-4891-aeed-e2204b3b2662", "address": "fa:16:3e:fb:74:f9", "network": {"id": "a530c6b7-d1f7-4659-8695-01e8168ae405", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f64ce7ca5af542c6bac7486e15930969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d250e6-f7", "ovs_interfaceid": "b0d250e6-f783-4891-aeed-e2204b3b2662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Releasing lock "refresh_cache-3827c534-7f4a-4f22-bf88-91e8897c6285" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.compute.manager [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Instance network_info: |[{"id": "b0d250e6-f783-4891-aeed-e2204b3b2662", "address": "fa:16:3e:fb:74:f9", "network": {"id": "a530c6b7-d1f7-4659-8695-01e8168ae405", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f64ce7ca5af542c6bac7486e15930969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d250e6-f7", "ovs_interfaceid": "b0d250e6-f783-4891-aeed-e2204b3b2662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Start _get_guest_xml network_info=[{"id": "b0d250e6-f783-4891-aeed-e2204b3b2662", "address": "fa:16:3e:fb:74:f9", "network": {"id": "a530c6b7-d1f7-4659-8695-01e8168ae405", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f64ce7ca5af542c6bac7486e15930969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d250e6-f7", "ovs_interfaceid": "b0d250e6-f783-4891-aeed-e2204b3b2662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:57:01 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:57:01 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1646401490',display_name='tempest-VolumesNegativeTest-instance-1646401490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1646401490',id=19,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd34c505d1bc40a394bfbd2ae2edd9fb',ramdisk_id='',reservation_id='r-yr8oy6wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-523576533',owner_user_name='tempest-VolumesNegativeTest-523576533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:56:59Z,user_data=None,user_id='ac9601d0624f4a19863473f6b14f2bf3',uuid=3827c534-7f4a-4f22-bf88-91e8897c6285,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0d250e6-f783-4891-aeed-e2204b3b2662", "address": "fa:16:3e:fb:74:f9", "network": {"id": "a530c6b7-d1f7-4659-8695-01e8168ae405", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f64ce7ca5af542c6bac7486e15930969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d250e6-f7", "ovs_interfaceid": "b0d250e6-f783-4891-aeed-e2204b3b2662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Converting VIF {"id": "b0d250e6-f783-4891-aeed-e2204b3b2662", "address": "fa:16:3e:fb:74:f9", "network": {"id": "a530c6b7-d1f7-4659-8695-01e8168ae405", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f64ce7ca5af542c6bac7486e15930969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d250e6-f7", "ovs_interfaceid": "b0d250e6-f783-4891-aeed-e2204b3b2662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:74:f9,bridge_name='br-int',has_traffic_filtering=True,id=b0d250e6-f783-4891-aeed-e2204b3b2662,network=Network(a530c6b7-d1f7-4659-8695-01e8168ae405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d250e6-f7') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.objects.instance [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lazy-loading 'pci_devices' on Instance uuid 3827c534-7f4a-4f22-bf88-91e8897c6285 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:57:01 user nova-compute[82184]:   <uuid>3827c534-7f4a-4f22-bf88-91e8897c6285</uuid>
Apr 12 01:57:01 user nova-compute[82184]:   <name>instance-00000013</name>
Apr 12 01:57:01 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:57:01 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:57:01 user nova-compute[82184]:   <metadata>
Apr 12 01:57:01 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:57:01 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:57:01 user nova-compute[82184]:       <nova:name>tempest-VolumesNegativeTest-instance-1646401490</nova:name>
Apr 12 01:57:01 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:57:01</nova:creationTime>
Apr 12 01:57:01 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:57:01 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:57:01 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:57:01 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:57:01 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:57:01 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:57:01 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:57:01 user nova-compute[82184]:       <nova:owner>
Apr 12 01:57:01 user nova-compute[82184]:         <nova:user uuid="ac9601d0624f4a19863473f6b14f2bf3">tempest-VolumesNegativeTest-523576533-project-member</nova:user>
Apr 12 01:57:01 user nova-compute[82184]:         <nova:project uuid="fd34c505d1bc40a394bfbd2ae2edd9fb">tempest-VolumesNegativeTest-523576533</nova:project>
Apr 12 01:57:01 user nova-compute[82184]:       </nova:owner>
Apr 12 01:57:01 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:57:01 user nova-compute[82184]:       <nova:ports>
Apr 12 01:57:01 user nova-compute[82184]:         <nova:port uuid="b0d250e6-f783-4891-aeed-e2204b3b2662">
Apr 12 01:57:01 user nova-compute[82184]:           <nova:ip type="fixed" address="192.168.233.143" ipVersion="4"/>
Apr 12 01:57:01 user nova-compute[82184]:         </nova:port>
Apr 12 01:57:01 user nova-compute[82184]:       </nova:ports>
Apr 12 01:57:01 user nova-compute[82184]:     </nova:instance>
Apr 12 01:57:01 user nova-compute[82184]:   </metadata>
Apr 12 01:57:01 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:57:01 user nova-compute[82184]:     <system>
Apr 12 01:57:01 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:57:01 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:57:01 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:57:01 user nova-compute[82184]:       <entry name="serial">3827c534-7f4a-4f22-bf88-91e8897c6285</entry>
Apr 12 01:57:01 user nova-compute[82184]:       <entry name="uuid">3827c534-7f4a-4f22-bf88-91e8897c6285</entry>
Apr 12 01:57:01 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:57:01 user nova-compute[82184]:     </system>
Apr 12 01:57:01 user nova-compute[82184]:   </sysinfo>
Apr 12 01:57:01 user nova-compute[82184]:   <os>
Apr 12 01:57:01 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:57:01 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:57:01 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:57:01 user nova-compute[82184]:   </os>
Apr 12 01:57:01 user nova-compute[82184]:   <features>
Apr 12 01:57:01 user nova-compute[82184]:     <acpi/>
Apr 12 01:57:01 user nova-compute[82184]:     <apic/>
Apr 12 01:57:01 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:57:01 user nova-compute[82184]:   </features>
Apr 12 01:57:01 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:57:01 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:57:01 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:57:01 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:57:01 user nova-compute[82184]:   </clock>
Apr 12 01:57:01 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:57:01 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:57:01 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:57:01 user nova-compute[82184]:   </cpu>
Apr 12 01:57:01 user nova-compute[82184]:   <devices>
Apr 12 01:57:01 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:57:01 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:57:01 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk"/>
Apr 12 01:57:01 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:57:01 user nova-compute[82184]:     </disk>
Apr 12 01:57:01 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:57:01 user nova-compute[82184]:       <mac address="fa:16:3e:fb:74:f9"/>
Apr 12 01:57:01 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:57:01 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:57:01 user nova-compute[82184]:       <target dev="tapb0d250e6-f7"/>
Apr 12 01:57:01 user nova-compute[82184]:     </interface>
Apr 12 01:57:01 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:57:01 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/console.log" append="off"/>
Apr 12 01:57:01 user nova-compute[82184]:     </serial>
Apr 12 01:57:01 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:57:01 user nova-compute[82184]:     <video>
Apr 12 01:57:01 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:57:01 user nova-compute[82184]:     </video>
Apr 12 01:57:01 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:57:01 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:57:01 user nova-compute[82184]:     </rng>
Apr 12 01:57:01 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:57:01 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:57:01 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:57:01 user nova-compute[82184]:     </memballoon>
Apr 12 01:57:01 user nova-compute[82184]:   </devices>
Apr 12 01:57:01 user nova-compute[82184]: </domain>
Apr 12 01:57:01 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1646401490',display_name='tempest-VolumesNegativeTest-instance-1646401490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1646401490',id=19,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd34c505d1bc40a394bfbd2ae2edd9fb',ramdisk_id='',reservation_id='r-yr8oy6wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-523576533',owner_user_name='tempest-VolumesNegativeTest-523576533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:56:59Z,user_data=None,user_id='ac9601d0624f4a19863473f6b14f2bf3',uuid=3827c534-7f4a-4f22-bf88-91e8897c6285,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0d250e6-f783-4891-aeed-e2204b3b2662", "address": "fa:16:3e:fb:74:f9", "network": {"id": "a530c6b7-d1f7-4659-8695-01e8168ae405", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f64ce7ca5af542c6bac7486e15930969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d250e6-f7", "ovs_interfaceid": "b0d250e6-f783-4891-aeed-e2204b3b2662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Converting VIF {"id": "b0d250e6-f783-4891-aeed-e2204b3b2662", "address": "fa:16:3e:fb:74:f9", "network": {"id": "a530c6b7-d1f7-4659-8695-01e8168ae405", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f64ce7ca5af542c6bac7486e15930969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d250e6-f7", "ovs_interfaceid": "b0d250e6-f783-4891-aeed-e2204b3b2662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:74:f9,bridge_name='br-int',has_traffic_filtering=True,id=b0d250e6-f783-4891-aeed-e2204b3b2662,network=Network(a530c6b7-d1f7-4659-8695-01e8168ae405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d250e6-f7') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_vif [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:74:f9,bridge_name='br-int',has_traffic_filtering=True,id=b0d250e6-f783-4891-aeed-e2204b3b2662,network=Network(a530c6b7-d1f7-4659-8695-01e8168ae405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d250e6-f7') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0d250e6-f7, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0d250e6-f7, col_values=(('external_ids', {'iface-id': 'b0d250e6-f783-4891-aeed-e2204b3b2662', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:74:f9', 'vm-uuid': '3827c534-7f4a-4f22-bf88-91e8897c6285'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:01 user nova-compute[82184]: INFO os_vif [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:74:f9,bridge_name='br-int',has_traffic_filtering=True,id=b0d250e6-f783-4891-aeed-e2204b3b2662,network=Network(a530c6b7-d1f7-4659-8695-01e8168ae405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d250e6-f7')
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] No VIF found with MAC fa:16:3e:fb:74:f9, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsqpSRkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:57:01 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:57:01 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:57:01 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[69525625-c07d-4385-8182-75461e11a622]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:57:01 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a010549-a621-4d0e-a870-e6e1a4cbb1c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad] added
Apr 12 01:57:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f3f53f-aa53-42bf-a983-843acbed9118]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[010d0ca0-91a0-4b0c-bc30-13b83b59a991]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsqpSRkl {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wsqpSRkl" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b520bfc-5dcc-4c72-8c0e-291e0d2cafe7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wsqpSRkl'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bccc82-8e1e-4948-a667-9bef952f00e0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[787ed511-a09a-4b0c-b380-e9483f198a80]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:57:01 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:57:01 user nova-compute[82184]:  {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:57:01 user nova-compute[82184]: WARNING os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 01:57:01 user nova-compute[82184]: 
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-bdc69fb4-5b91-4755-8d90-9bae9cfbdaa7 req-e2324280-e6eb-4ba3-aac1-7d9d28439fd7 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Received event network-changed-b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-bdc69fb4-5b91-4755-8d90-9bae9cfbdaa7 req-e2324280-e6eb-4ba3-aac1-7d9d28439fd7 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Refreshing instance network info cache due to event network-changed-b0d250e6-f783-4891-aeed-e2204b3b2662. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bdc69fb4-5b91-4755-8d90-9bae9cfbdaa7 req-e2324280-e6eb-4ba3-aac1-7d9d28439fd7 service nova] Acquiring lock "refresh_cache-3827c534-7f4a-4f22-bf88-91e8897c6285" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bdc69fb4-5b91-4755-8d90-9bae9cfbdaa7 req-e2324280-e6eb-4ba3-aac1-7d9d28439fd7 service nova] Acquired lock "refresh_cache-3827c534-7f4a-4f22-bf88-91e8897c6285" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-bdc69fb4-5b91-4755-8d90-9bae9cfbdaa7 req-e2324280-e6eb-4ba3-aac1-7d9d28439fd7 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Refreshing network info cache for port b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7792cf-6abd-4c49-9026-eb93bdac3a43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad, portal: 172.16.0.220,3260]
Apr 12 01:57:01 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad, portal: 172.16.0.220,3260] successful.
Apr 12 01:57:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[85084806-fc6f-40a3-9279-bd32fa1fc5dc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ec0f1e-f151-4fc2-b1b3-d8eeb93786f5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad (non-flash)
Apr 12 01:57:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad (non-flash)
Apr 12 01:57:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[486dcad6-afe9-47a2-8252-41486e156bf8]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:02 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:57:02 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsqpSRkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:57:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-bdc69fb4-5b91-4755-8d90-9bae9cfbdaa7 req-e2324280-e6eb-4ba3-aac1-7d9d28439fd7 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Updated VIF entry in instance network info cache for port b0d250e6-f783-4891-aeed-e2204b3b2662. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:57:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-bdc69fb4-5b91-4755-8d90-9bae9cfbdaa7 req-e2324280-e6eb-4ba3-aac1-7d9d28439fd7 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Updating instance_info_cache with network_info: [{"id": "b0d250e6-f783-4891-aeed-e2204b3b2662", "address": "fa:16:3e:fb:74:f9", "network": {"id": "a530c6b7-d1f7-4659-8695-01e8168ae405", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f64ce7ca5af542c6bac7486e15930969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d250e6-f7", "ovs_interfaceid": "b0d250e6-f783-4891-aeed-e2204b3b2662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:57:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bdc69fb4-5b91-4755-8d90-9bae9cfbdaa7 req-e2324280-e6eb-4ba3-aac1-7d9d28439fd7 service nova] Releasing lock "refresh_cache-3827c534-7f4a-4f22-bf88-91e8897c6285" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:57:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23434393337626533', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434393337626533', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG nova.objects.instance [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lazy-loading 'flavor' on Instance uuid 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:57:03 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:57:03 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 01:57:03 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:57:03 user nova-compute[82184]:   <serial>0b915cc2-ce61-4b9d-832d-412e056f70ad</serial>
Apr 12 01:57:03 user nova-compute[82184]: </disk>
Apr 12 01:57:03 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-4b70313d-af04-481d-bb78-043e2e45ecba req-3c6120c9-e0a1-4d66-a510-76f1a48d96ad service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Received event network-vif-plugged-b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b70313d-af04-481d-bb78-043e2e45ecba req-3c6120c9-e0a1-4d66-a510-76f1a48d96ad service nova] Acquiring lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b70313d-af04-481d-bb78-043e2e45ecba req-3c6120c9-e0a1-4d66-a510-76f1a48d96ad service nova] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4b70313d-af04-481d-bb78-043e2e45ecba req-3c6120c9-e0a1-4d66-a510-76f1a48d96ad service nova] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-4b70313d-af04-481d-bb78-043e2e45ecba req-3c6120c9-e0a1-4d66-a510-76f1a48d96ad service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] No waiting events found dispatching network-vif-plugged-b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:57:03 user nova-compute[82184]: WARNING nova.compute.manager [req-4b70313d-af04-481d-bb78-043e2e45ecba req-3c6120c9-e0a1-4d66-a510-76f1a48d96ad service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Received unexpected event network-vif-plugged-b0d250e6-f783-4891-aeed-e2204b3b2662 for instance with vm_state building and task_state spawning.
Apr 12 01:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] No BDM found with device name hda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] No VIF found with MAC fa:16:3e:11:a5:b3, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:57:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-11cc6d73-9863-4d55-93ca-e59d42886719 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.796s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-f22c8efb-0967-4dfb-8937-0451870dbf68 req-501baadd-0541-4c1c-bfa1-7cd0011be468 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Received event network-vif-plugged-b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f22c8efb-0967-4dfb-8937-0451870dbf68 req-501baadd-0541-4c1c-bfa1-7cd0011be468 service nova] Acquiring lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f22c8efb-0967-4dfb-8937-0451870dbf68 req-501baadd-0541-4c1c-bfa1-7cd0011be468 service nova] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f22c8efb-0967-4dfb-8937-0451870dbf68 req-501baadd-0541-4c1c-bfa1-7cd0011be468 service nova] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-f22c8efb-0967-4dfb-8937-0451870dbf68 req-501baadd-0541-4c1c-bfa1-7cd0011be468 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] No waiting events found dispatching network-vif-plugged-b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:57:05 user nova-compute[82184]: WARNING nova.compute.manager [req-f22c8efb-0967-4dfb-8937-0451870dbf68 req-501baadd-0541-4c1c-bfa1-7cd0011be468 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Received unexpected event network-vif-plugged-b0d250e6-f783-4891-aeed-e2204b3b2662 for instance with vm_state building and task_state spawning.
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.compute.manager [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Detaching volume 0b915cc2-ce61-4b9d-832d-412e056f70ad
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.virt.block_device [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Attempting to driver detach volume 0b915cc2-ce61-4b9d-832d-412e056f70ad from mountpoint /dev/vdb
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Attempting to detach device vdb from instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:57:05 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:57:05 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 01:57:05 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:57:05 user nova-compute[82184]:   <serial>0b915cc2-ce61-4b9d-832d-412e056f70ad</serial>
Apr 12 01:57:05 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 01:57:05 user nova-compute[82184]: </disk>
Apr 12 01:57:05 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Successfully detached device vdb from instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 from the persistent domain config.
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:57:05 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:57:05 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 01:57:05 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:57:05 user nova-compute[82184]:   <serial>0b915cc2-ce61-4b9d-832d-412e056f70ad</serial>
Apr 12 01:57:05 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 01:57:05 user nova-compute[82184]: </disk>
Apr 12 01:57:05 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264625.493114, 3827c534-7f4a-4f22-bf88-91e8897c6285 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] VM Resumed (Lifecycle Event)
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Instance spawned successfully.
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264625.497791, 3827c534-7f4a-4f22-bf88-91e8897c6285 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] VM Started (Lifecycle Event)
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.compute.manager [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Took 6.19 seconds to spawn the instance on the hypervisor.
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.compute.manager [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Took 7.23 seconds to build instance.
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-36baf0e7-1af9-4bf2-864d-2ab2acc6c603 tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.322s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264625.833852, 5b7cbacb-f776-4e9a-b333-ce9c345dc525 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:57:05 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Successfully detached device vdb from instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 from the live domain config.
Apr 12 01:57:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wsqpSRkl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:57:05 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bcd949-83d2-4358-a6cc-0756a603a2a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:57:05 user nova-compute[82184]: No targets found.
Apr 12 01:57:05 user nova-compute[82184]: iSNS:
Apr 12 01:57:05 user nova-compute[82184]: No targets found.
Apr 12 01:57:05 user nova-compute[82184]: STATIC:
Apr 12 01:57:05 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad
Apr 12 01:57:05 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:57:05 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:57:05 user nova-compute[82184]: FIRMWARE:
Apr 12 01:57:05 user nova-compute[82184]: No targets found.
Apr 12 01:57:05 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:57:05 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:57:05 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c0da65-54b8-4da0-a5c7-5ed310765cda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d4e046-e815-4c0c-adb6-b6ccbda6abc2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad (non-flash)
Apr 12 01:57:05 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad (non-flash)
Apr 12 01:57:05 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a80e8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efb9ff1-3162-40e6-bb83-5354d939f2a7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70bf052-995e-4487-9843-5b949d2403e5]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cb6fa7-c2c9-48d4-a346-dbe7660293f8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:57:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ac0f6b-5fb0-400c-998d-befda8082c97]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e6b91-2624-4ded-be92-bf7b2e350bb8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[69532321-1e77-41ef-92a9-c3aa3bbf4699]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad, portal: 172.16.0.220,3260]
Apr 12 01:57:06 user nova-compute[82184]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad, portal: 172.16.0.220,3260] successful.
Apr 12 01:57:06 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b915cc2-ce61-4b9d-832d-412e056f70ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0188124a-73af-44d9-820c-f1f3f8d29a78]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] <== disconnect_volume: return (310ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:06 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lazy-loading 'flavor' on Instance uuid 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a40d6f49-8736-4537-a6c8-87bf605bb95e tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "interface-5b7cbacb-f776-4e9a-b333-ce9c345dc525-bb6652b3-90cf-4337-a94b-ca982c4397f5" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "interface-5b7cbacb-f776-4e9a-b333-ce9c345dc525-bb6652b3-90cf-4337-a94b-ca982c4397f5" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.objects.instance [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lazy-loading 'flavor' on Instance uuid 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211209472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-211209472',id=17,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlxYLGiDT3ULykrJ/16FAYLe9mlS7WpoHsNkE+Oww0i5S0/0HEU1ZMf1BlJ8O7u24iaXO1qwL8Qcg5/TeN5uRr2keoVwu2xaLtJctivU4Ipg77M6FqVNyx8y2JxOGS9rQ==',key_name='tempest-keypair-1476535441',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:55:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3443faad6b314920a85b8491603e30ac',ramdisk_id='',reservation_id='r-jpcow580',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1804071739',owner_user_name='tempest-TaggedAttachmentsTest-1804071739-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43819af3565d4eff92ce1a51f86df4f2',uuid=5b7cbacb-f776-4e9a-b333-ce9c345dc525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "address": "fa:16:3e:7a:8a:36", "network": {"id": "2dceb67c-b24a-4d04-b054-93f03677d195", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-630581707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6652b3-90", "ovs_interfaceid": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converting VIF {"id": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "address": "fa:16:3e:7a:8a:36", "network": {"id": "2dceb67c-b24a-4d04-b054-93f03677d195", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-630581707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6652b3-90", "ovs_interfaceid": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:36,bridge_name='br-int',has_traffic_filtering=True,id=bb6652b3-90cf-4337-a94b-ca982c4397f5,network=Network(2dceb67c-b24a-4d04-b054-93f03677d195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6652b3-90') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:8a:36"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb6652b3-90"/></interface> {{(pid=82184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:8a:36"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb6652b3-90"/></interface> {{(pid=82184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Attempting to detach device tapbb6652b3-90 from instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] detach device xml: <interface type="ethernet">
Apr 12 01:57:07 user nova-compute[82184]:   <mac address="fa:16:3e:7a:8a:36"/>
Apr 12 01:57:07 user nova-compute[82184]:   <model type="virtio"/>
Apr 12 01:57:07 user nova-compute[82184]:   <mtu size="1442"/>
Apr 12 01:57:07 user nova-compute[82184]:   <target dev="tapbb6652b3-90"/>
Apr 12 01:57:07 user nova-compute[82184]: </interface>
Apr 12 01:57:07 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:8a:36"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb6652b3-90"/></interface> {{(pid=82184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:8a:36"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb6652b3-90"/></interface>not found in domain: <domain type='kvm' id='21'>
Apr 12 01:57:07 user nova-compute[82184]:   <name>instance-00000011</name>
Apr 12 01:57:07 user nova-compute[82184]:   <uuid>5b7cbacb-f776-4e9a-b333-ce9c345dc525</uuid>
Apr 12 01:57:07 user nova-compute[82184]:   <metadata>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:57:07 user nova-compute[82184]:   <nova:package version="0.0.0"/>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:name>tempest-device-tagging-server-211209472</nova:name>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:creationTime>2023-04-12 01:56:56</nova:creationTime>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:flavor name="m1.nano">
Apr 12 01:57:07 user nova-compute[82184]:     <nova:memory>128</nova:memory>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:disk>1</nova:disk>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:swap>0</nova:swap>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:vcpus>1</nova:vcpus>
Apr 12 01:57:07 user nova-compute[82184]:   </nova:flavor>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:owner>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:user uuid="43819af3565d4eff92ce1a51f86df4f2">tempest-TaggedAttachmentsTest-1804071739-project-member</nova:user>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:project uuid="3443faad6b314920a85b8491603e30ac">tempest-TaggedAttachmentsTest-1804071739</nova:project>
Apr 12 01:57:07 user nova-compute[82184]:   </nova:owner>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:ports>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:port uuid="0e649e0b-d93b-473c-a765-b0173cea1a6d">
Apr 12 01:57:07 user nova-compute[82184]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 01:57:07 user nova-compute[82184]:     </nova:port>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:port uuid="bb6652b3-90cf-4337-a94b-ca982c4397f5">
Apr 12 01:57:07 user nova-compute[82184]:       <nova:ip type="fixed" address="10.10.10.50" ipVersion="4"/>
Apr 12 01:57:07 user nova-compute[82184]:     </nova:port>
Apr 12 01:57:07 user nova-compute[82184]:   </nova:ports>
Apr 12 01:57:07 user nova-compute[82184]: </nova:instance>
Apr 12 01:57:07 user nova-compute[82184]:   </metadata>
Apr 12 01:57:07 user nova-compute[82184]:   <memory unit='KiB'>131072</memory>
Apr 12 01:57:07 user nova-compute[82184]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 01:57:07 user nova-compute[82184]:   <vcpu placement='static'>1</vcpu>
Apr 12 01:57:07 user nova-compute[82184]:   <resource>
Apr 12 01:57:07 user nova-compute[82184]:     <partition>/machine</partition>
Apr 12 01:57:07 user nova-compute[82184]:   </resource>
Apr 12 01:57:07 user nova-compute[82184]:   <sysinfo type='smbios'>
Apr 12 01:57:07 user nova-compute[82184]:     <system>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='version'>0.0.0</entry>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='serial'>5b7cbacb-f776-4e9a-b333-ce9c345dc525</entry>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='uuid'>5b7cbacb-f776-4e9a-b333-ce9c345dc525</entry>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='family'>Virtual Machine</entry>
Apr 12 01:57:07 user nova-compute[82184]:     </system>
Apr 12 01:57:07 user nova-compute[82184]:   </sysinfo>
Apr 12 01:57:07 user nova-compute[82184]:   <os>
Apr 12 01:57:07 user nova-compute[82184]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 01:57:07 user nova-compute[82184]:     <boot dev='hd'/>
Apr 12 01:57:07 user nova-compute[82184]:     <smbios mode='sysinfo'/>
Apr 12 01:57:07 user nova-compute[82184]:   </os>
Apr 12 01:57:07 user nova-compute[82184]:   <features>
Apr 12 01:57:07 user nova-compute[82184]:     <acpi/>
Apr 12 01:57:07 user nova-compute[82184]:     <apic/>
Apr 12 01:57:07 user nova-compute[82184]:     <vmcoreinfo state='on'/>
Apr 12 01:57:07 user nova-compute[82184]:   </features>
Apr 12 01:57:07 user nova-compute[82184]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 01:57:07 user nova-compute[82184]:     <model fallback='forbid'>Nehalem</model>
Apr 12 01:57:07 user nova-compute[82184]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 01:57:07 user nova-compute[82184]:     <feature policy='require' name='vme'/>
Apr 12 01:57:07 user nova-compute[82184]:     <feature policy='require' name='x2apic'/>
Apr 12 01:57:07 user nova-compute[82184]:     <feature policy='require' name='hypervisor'/>
Apr 12 01:57:07 user nova-compute[82184]:   </cpu>
Apr 12 01:57:07 user nova-compute[82184]:   <clock offset='utc'>
Apr 12 01:57:07 user nova-compute[82184]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 01:57:07 user nova-compute[82184]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 01:57:07 user nova-compute[82184]:     <timer name='hpet' present='no'/>
Apr 12 01:57:07 user nova-compute[82184]:   </clock>
Apr 12 01:57:07 user nova-compute[82184]:   <on_poweroff>destroy</on_poweroff>
Apr 12 01:57:07 user nova-compute[82184]:   <on_reboot>restart</on_reboot>
Apr 12 01:57:07 user nova-compute[82184]:   <on_crash>destroy</on_crash>
Apr 12 01:57:07 user nova-compute[82184]:   <devices>
Apr 12 01:57:07 user nova-compute[82184]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 01:57:07 user nova-compute[82184]:     <disk type='file' device='disk'>
Apr 12 01:57:07 user nova-compute[82184]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 01:57:07 user nova-compute[82184]:       <source file='/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk' index='2'/>
Apr 12 01:57:07 user nova-compute[82184]:       <backingStore type='file' index='3'>
Apr 12 01:57:07 user nova-compute[82184]:         <format type='raw'/>
Apr 12 01:57:07 user nova-compute[82184]:         <source file='/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690'/>
Apr 12 01:57:07 user nova-compute[82184]:         <backingStore/>
Apr 12 01:57:07 user nova-compute[82184]:       </backingStore>
Apr 12 01:57:07 user nova-compute[82184]:       <target dev='vda' bus='virtio'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='virtio-disk0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </disk>
Apr 12 01:57:07 user nova-compute[82184]:     <disk type='file' device='cdrom'>
Apr 12 01:57:07 user nova-compute[82184]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 01:57:07 user nova-compute[82184]:       <source file='/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk.config' index='1'/>
Apr 12 01:57:07 user nova-compute[82184]:       <backingStore/>
Apr 12 01:57:07 user nova-compute[82184]:       <target dev='hda' bus='ide'/>
Apr 12 01:57:07 user nova-compute[82184]:       <readonly/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='ide0-0-0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </disk>
Apr 12 01:57:07 user nova-compute[82184]:     <controller type='usb' index='0' model='none'>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='usb'/>
Apr 12 01:57:07 user nova-compute[82184]:     </controller>
Apr 12 01:57:07 user nova-compute[82184]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='pci.0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </controller>
Apr 12 01:57:07 user nova-compute[82184]:     <controller type='ide' index='0'>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='ide'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 01:57:07 user nova-compute[82184]:     </controller>
Apr 12 01:57:07 user nova-compute[82184]:     <interface type='ethernet'>
Apr 12 01:57:07 user nova-compute[82184]:       <mac address='fa:16:3e:11:a5:b3'/>
Apr 12 01:57:07 user nova-compute[82184]:       <target dev='tap0e649e0b-d9'/>
Apr 12 01:57:07 user nova-compute[82184]:       <model type='virtio'/>
Apr 12 01:57:07 user nova-compute[82184]:       <mtu size='1442'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='net0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </interface>
Apr 12 01:57:07 user nova-compute[82184]:     <interface type='ethernet'>
Apr 12 01:57:07 user nova-compute[82184]:       <mac address='fa:16:3e:7a:8a:36'/>
Apr 12 01:57:07 user nova-compute[82184]:       <target dev='tapbb6652b3-90'/>
Apr 12 01:57:07 user nova-compute[82184]:       <model type='virtio'/>
Apr 12 01:57:07 user nova-compute[82184]:       <mtu size='1442'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='net1'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </interface>
Apr 12 01:57:07 user nova-compute[82184]:     <serial type='pty'>
Apr 12 01:57:07 user nova-compute[82184]:       <source path='/dev/pts/10'/>
Apr 12 01:57:07 user nova-compute[82184]:       <log file='/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/console.log' append='off'/>
Apr 12 01:57:07 user nova-compute[82184]:       <target type='isa-serial' port='0'>
Apr 12 01:57:07 user nova-compute[82184]:         <model name='isa-serial'/>
Apr 12 01:57:07 user nova-compute[82184]:       </target>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='serial0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </serial>
Apr 12 01:57:07 user nova-compute[82184]:     <console type='pty' tty='/dev/pts/10'>
Apr 12 01:57:07 user nova-compute[82184]:       <source path='/dev/pts/10'/>
Apr 12 01:57:07 user nova-compute[82184]:       <log file='/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/console.log' append='off'/>
Apr 12 01:57:07 user nova-compute[82184]:       <target type='serial' port='0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='serial0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </console>
Apr 12 01:57:07 user nova-compute[82184]:     <input type='mouse' bus='ps2'>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='input0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </input>
Apr 12 01:57:07 user nova-compute[82184]:     <input type='keyboard' bus='ps2'>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='input1'/>
Apr 12 01:57:07 user nova-compute[82184]:     </input>
Apr 12 01:57:07 user nova-compute[82184]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 12 01:57:07 user nova-compute[82184]:       <listen type='address' address='0.0.0.0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </graphics>
Apr 12 01:57:07 user nova-compute[82184]:     <audio id='1' type='none'/>
Apr 12 01:57:07 user nova-compute[82184]:     <video>
Apr 12 01:57:07 user nova-compute[82184]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='video0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </video>
Apr 12 01:57:07 user nova-compute[82184]:     <memballoon model='virtio'>
Apr 12 01:57:07 user nova-compute[82184]:       <stats period='10'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='balloon0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </memballoon>
Apr 12 01:57:07 user nova-compute[82184]:     <rng model='virtio'>
Apr 12 01:57:07 user nova-compute[82184]:       <backend model='random'>/dev/urandom</backend>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='rng0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </rng>
Apr 12 01:57:07 user nova-compute[82184]:   </devices>
Apr 12 01:57:07 user nova-compute[82184]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 01:57:07 user nova-compute[82184]:     <label>libvirt-5b7cbacb-f776-4e9a-b333-ce9c345dc525</label>
Apr 12 01:57:07 user nova-compute[82184]:     <imagelabel>libvirt-5b7cbacb-f776-4e9a-b333-ce9c345dc525</imagelabel>
Apr 12 01:57:07 user nova-compute[82184]:   </seclabel>
Apr 12 01:57:07 user nova-compute[82184]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 01:57:07 user nova-compute[82184]:     <label>+64055:+108</label>
Apr 12 01:57:07 user nova-compute[82184]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 01:57:07 user nova-compute[82184]:   </seclabel>
Apr 12 01:57:07 user nova-compute[82184]: </domain>
Apr 12 01:57:07 user nova-compute[82184]:  {{(pid=82184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 01:57:07 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Successfully detached device tapbb6652b3-90 from instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 from the persistent domain config.
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] (1/8): Attempting to detach device tapbb6652b3-90 with device alias net1 from instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] detach device xml: <interface type="ethernet">
Apr 12 01:57:07 user nova-compute[82184]:   <mac address="fa:16:3e:7a:8a:36"/>
Apr 12 01:57:07 user nova-compute[82184]:   <model type="virtio"/>
Apr 12 01:57:07 user nova-compute[82184]:   <mtu size="1442"/>
Apr 12 01:57:07 user nova-compute[82184]:   <target dev="tapbb6652b3-90"/>
Apr 12 01:57:07 user nova-compute[82184]: </interface>
Apr 12 01:57:07 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264627.956698, 5b7cbacb-f776-4e9a-b333-ce9c345dc525 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Start waiting for the detach event from libvirt for device tapbb6652b3-90 with device alias net1 for instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:8a:36"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb6652b3-90"/></interface> {{(pid=82184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:8a:36"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb6652b3-90"/></interface>not found in domain: <domain type='kvm' id='21'>
Apr 12 01:57:07 user nova-compute[82184]:   <name>instance-00000011</name>
Apr 12 01:57:07 user nova-compute[82184]:   <uuid>5b7cbacb-f776-4e9a-b333-ce9c345dc525</uuid>
Apr 12 01:57:07 user nova-compute[82184]:   <metadata>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:57:07 user nova-compute[82184]:   <nova:package version="0.0.0"/>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:name>tempest-device-tagging-server-211209472</nova:name>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:creationTime>2023-04-12 01:56:56</nova:creationTime>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:flavor name="m1.nano">
Apr 12 01:57:07 user nova-compute[82184]:     <nova:memory>128</nova:memory>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:disk>1</nova:disk>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:swap>0</nova:swap>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:vcpus>1</nova:vcpus>
Apr 12 01:57:07 user nova-compute[82184]:   </nova:flavor>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:owner>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:user uuid="43819af3565d4eff92ce1a51f86df4f2">tempest-TaggedAttachmentsTest-1804071739-project-member</nova:user>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:project uuid="3443faad6b314920a85b8491603e30ac">tempest-TaggedAttachmentsTest-1804071739</nova:project>
Apr 12 01:57:07 user nova-compute[82184]:   </nova:owner>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:57:07 user nova-compute[82184]:   <nova:ports>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:port uuid="0e649e0b-d93b-473c-a765-b0173cea1a6d">
Apr 12 01:57:07 user nova-compute[82184]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 01:57:07 user nova-compute[82184]:     </nova:port>
Apr 12 01:57:07 user nova-compute[82184]:     <nova:port uuid="bb6652b3-90cf-4337-a94b-ca982c4397f5">
Apr 12 01:57:07 user nova-compute[82184]:       <nova:ip type="fixed" address="10.10.10.50" ipVersion="4"/>
Apr 12 01:57:07 user nova-compute[82184]:     </nova:port>
Apr 12 01:57:07 user nova-compute[82184]:   </nova:ports>
Apr 12 01:57:07 user nova-compute[82184]: </nova:instance>
Apr 12 01:57:07 user nova-compute[82184]:   </metadata>
Apr 12 01:57:07 user nova-compute[82184]:   <memory unit='KiB'>131072</memory>
Apr 12 01:57:07 user nova-compute[82184]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 01:57:07 user nova-compute[82184]:   <vcpu placement='static'>1</vcpu>
Apr 12 01:57:07 user nova-compute[82184]:   <resource>
Apr 12 01:57:07 user nova-compute[82184]:     <partition>/machine</partition>
Apr 12 01:57:07 user nova-compute[82184]:   </resource>
Apr 12 01:57:07 user nova-compute[82184]:   <sysinfo type='smbios'>
Apr 12 01:57:07 user nova-compute[82184]:     <system>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='version'>0.0.0</entry>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='serial'>5b7cbacb-f776-4e9a-b333-ce9c345dc525</entry>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='uuid'>5b7cbacb-f776-4e9a-b333-ce9c345dc525</entry>
Apr 12 01:57:07 user nova-compute[82184]:       <entry name='family'>Virtual Machine</entry>
Apr 12 01:57:07 user nova-compute[82184]:     </system>
Apr 12 01:57:07 user nova-compute[82184]:   </sysinfo>
Apr 12 01:57:07 user nova-compute[82184]:   <os>
Apr 12 01:57:07 user nova-compute[82184]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 01:57:07 user nova-compute[82184]:     <boot dev='hd'/>
Apr 12 01:57:07 user nova-compute[82184]:     <smbios mode='sysinfo'/>
Apr 12 01:57:07 user nova-compute[82184]:   </os>
Apr 12 01:57:07 user nova-compute[82184]:   <features>
Apr 12 01:57:07 user nova-compute[82184]:     <acpi/>
Apr 12 01:57:07 user nova-compute[82184]:     <apic/>
Apr 12 01:57:07 user nova-compute[82184]:     <vmcoreinfo state='on'/>
Apr 12 01:57:07 user nova-compute[82184]:   </features>
Apr 12 01:57:07 user nova-compute[82184]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 01:57:07 user nova-compute[82184]:     <model fallback='forbid'>Nehalem</model>
Apr 12 01:57:07 user nova-compute[82184]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 01:57:07 user nova-compute[82184]:     <feature policy='require' name='vme'/>
Apr 12 01:57:07 user nova-compute[82184]:     <feature policy='require' name='x2apic'/>
Apr 12 01:57:07 user nova-compute[82184]:     <feature policy='require' name='hypervisor'/>
Apr 12 01:57:07 user nova-compute[82184]:   </cpu>
Apr 12 01:57:07 user nova-compute[82184]:   <clock offset='utc'>
Apr 12 01:57:07 user nova-compute[82184]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 01:57:07 user nova-compute[82184]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 01:57:07 user nova-compute[82184]:     <timer name='hpet' present='no'/>
Apr 12 01:57:07 user nova-compute[82184]:   </clock>
Apr 12 01:57:07 user nova-compute[82184]:   <on_poweroff>destroy</on_poweroff>
Apr 12 01:57:07 user nova-compute[82184]:   <on_reboot>restart</on_reboot>
Apr 12 01:57:07 user nova-compute[82184]:   <on_crash>destroy</on_crash>
Apr 12 01:57:07 user nova-compute[82184]:   <devices>
Apr 12 01:57:07 user nova-compute[82184]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 01:57:07 user nova-compute[82184]:     <disk type='file' device='disk'>
Apr 12 01:57:07 user nova-compute[82184]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 01:57:07 user nova-compute[82184]:       <source file='/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk' index='2'/>
Apr 12 01:57:07 user nova-compute[82184]:       <backingStore type='file' index='3'>
Apr 12 01:57:07 user nova-compute[82184]:         <format type='raw'/>
Apr 12 01:57:07 user nova-compute[82184]:         <source file='/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690'/>
Apr 12 01:57:07 user nova-compute[82184]:         <backingStore/>
Apr 12 01:57:07 user nova-compute[82184]:       </backingStore>
Apr 12 01:57:07 user nova-compute[82184]:       <target dev='vda' bus='virtio'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='virtio-disk0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </disk>
Apr 12 01:57:07 user nova-compute[82184]:     <disk type='file' device='cdrom'>
Apr 12 01:57:07 user nova-compute[82184]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 01:57:07 user nova-compute[82184]:       <source file='/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk.config' index='1'/>
Apr 12 01:57:07 user nova-compute[82184]:       <backingStore/>
Apr 12 01:57:07 user nova-compute[82184]:       <target dev='hda' bus='ide'/>
Apr 12 01:57:07 user nova-compute[82184]:       <readonly/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='ide0-0-0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </disk>
Apr 12 01:57:07 user nova-compute[82184]:     <controller type='usb' index='0' model='none'>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='usb'/>
Apr 12 01:57:07 user nova-compute[82184]:     </controller>
Apr 12 01:57:07 user nova-compute[82184]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='pci.0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </controller>
Apr 12 01:57:07 user nova-compute[82184]:     <controller type='ide' index='0'>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='ide'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 01:57:07 user nova-compute[82184]:     </controller>
Apr 12 01:57:07 user nova-compute[82184]:     <interface type='ethernet'>
Apr 12 01:57:07 user nova-compute[82184]:       <mac address='fa:16:3e:11:a5:b3'/>
Apr 12 01:57:07 user nova-compute[82184]:       <target dev='tap0e649e0b-d9'/>
Apr 12 01:57:07 user nova-compute[82184]:       <model type='virtio'/>
Apr 12 01:57:07 user nova-compute[82184]:       <mtu size='1442'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='net0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </interface>
Apr 12 01:57:07 user nova-compute[82184]:     <serial type='pty'>
Apr 12 01:57:07 user nova-compute[82184]:       <source path='/dev/pts/10'/>
Apr 12 01:57:07 user nova-compute[82184]:       <log file='/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/console.log' append='off'/>
Apr 12 01:57:07 user nova-compute[82184]:       <target type='isa-serial' port='0'>
Apr 12 01:57:07 user nova-compute[82184]:         <model name='isa-serial'/>
Apr 12 01:57:07 user nova-compute[82184]:       </target>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='serial0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </serial>
Apr 12 01:57:07 user nova-compute[82184]:     <console type='pty' tty='/dev/pts/10'>
Apr 12 01:57:07 user nova-compute[82184]:       <source path='/dev/pts/10'/>
Apr 12 01:57:07 user nova-compute[82184]:       <log file='/opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/console.log' append='off'/>
Apr 12 01:57:07 user nova-compute[82184]:       <target type='serial' port='0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='serial0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </console>
Apr 12 01:57:07 user nova-compute[82184]:     <input type='mouse' bus='ps2'>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='input0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </input>
Apr 12 01:57:07 user nova-compute[82184]:     <input type='keyboard' bus='ps2'>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='input1'/>
Apr 12 01:57:07 user nova-compute[82184]:     </input>
Apr 12 01:57:07 user nova-compute[82184]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Apr 12 01:57:07 user nova-compute[82184]:       <listen type='address' address='0.0.0.0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </graphics>
Apr 12 01:57:07 user nova-compute[82184]:     <audio id='1' type='none'/>
Apr 12 01:57:07 user nova-compute[82184]:     <video>
Apr 12 01:57:07 user nova-compute[82184]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='video0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </video>
Apr 12 01:57:07 user nova-compute[82184]:     <memballoon model='virtio'>
Apr 12 01:57:07 user nova-compute[82184]:       <stats period='10'/>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='balloon0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </memballoon>
Apr 12 01:57:07 user nova-compute[82184]:     <rng model='virtio'>
Apr 12 01:57:07 user nova-compute[82184]:       <backend model='random'>/dev/urandom</backend>
Apr 12 01:57:07 user nova-compute[82184]:       <alias name='rng0'/>
Apr 12 01:57:07 user nova-compute[82184]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 01:57:07 user nova-compute[82184]:     </rng>
Apr 12 01:57:07 user nova-compute[82184]:   </devices>
Apr 12 01:57:07 user nova-compute[82184]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 01:57:07 user nova-compute[82184]:     <label>libvirt-5b7cbacb-f776-4e9a-b333-ce9c345dc525</label>
Apr 12 01:57:07 user nova-compute[82184]:     <imagelabel>libvirt-5b7cbacb-f776-4e9a-b333-ce9c345dc525</imagelabel>
Apr 12 01:57:07 user nova-compute[82184]:   </seclabel>
Apr 12 01:57:07 user nova-compute[82184]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 01:57:07 user nova-compute[82184]:     <label>+64055:+108</label>
Apr 12 01:57:07 user nova-compute[82184]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 01:57:07 user nova-compute[82184]:   </seclabel>
Apr 12 01:57:07 user nova-compute[82184]: </domain>
Apr 12 01:57:07 user nova-compute[82184]:  {{(pid=82184) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 01:57:07 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Successfully detached device tapbb6652b3-90 from instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 from the live domain config.
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211209472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-211209472',id=17,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlxYLGiDT3ULykrJ/16FAYLe9mlS7WpoHsNkE+Oww0i5S0/0HEU1ZMf1BlJ8O7u24iaXO1qwL8Qcg5/TeN5uRr2keoVwu2xaLtJctivU4Ipg77M6FqVNyx8y2JxOGS9rQ==',key_name='tempest-keypair-1476535441',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:55:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3443faad6b314920a85b8491603e30ac',ramdisk_id='',reservation_id='r-jpcow580',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1804071739',owner_user_name='tempest-TaggedAttachmentsTest-1804071739-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43819af3565d4eff92ce1a51f86df4f2',uuid=5b7cbacb-f776-4e9a-b333-ce9c345dc525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "address": "fa:16:3e:7a:8a:36", "network": {"id": "2dceb67c-b24a-4d04-b054-93f03677d195", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-630581707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6652b3-90", "ovs_interfaceid": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converting VIF {"id": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "address": "fa:16:3e:7a:8a:36", "network": {"id": "2dceb67c-b24a-4d04-b054-93f03677d195", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-630581707", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6652b3-90", "ovs_interfaceid": "bb6652b3-90cf-4337-a94b-ca982c4397f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:36,bridge_name='br-int',has_traffic_filtering=True,id=bb6652b3-90cf-4337-a94b-ca982c4397f5,network=Network(2dceb67c-b24a-4d04-b054-93f03677d195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6652b3-90') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG os_vif [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:36,bridge_name='br-int',has_traffic_filtering=True,id=bb6652b3-90cf-4337-a94b-ca982c4397f5,network=Network(2dceb67c-b24a-4d04-b054-93f03677d195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6652b3-90') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb6652b3-90, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:57:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:08 user nova-compute[82184]: INFO os_vif [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8a:36,bridge_name='br-int',has_traffic_filtering=True,id=bb6652b3-90cf-4337-a94b-ca982c4397f5,network=Network(2dceb67c-b24a-4d04-b054-93f03677d195),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6652b3-90')
Apr 12 01:57:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:57:08 user nova-compute[82184]:   <nova:package version="0.0.0"/>
Apr 12 01:57:08 user nova-compute[82184]:   <nova:name>tempest-device-tagging-server-211209472</nova:name>
Apr 12 01:57:08 user nova-compute[82184]:   <nova:creationTime>2023-04-12 01:57:08</nova:creationTime>
Apr 12 01:57:08 user nova-compute[82184]:   <nova:flavor name="m1.nano">
Apr 12 01:57:08 user nova-compute[82184]:     <nova:memory>128</nova:memory>
Apr 12 01:57:08 user nova-compute[82184]:     <nova:disk>1</nova:disk>
Apr 12 01:57:08 user nova-compute[82184]:     <nova:swap>0</nova:swap>
Apr 12 01:57:08 user nova-compute[82184]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:57:08 user nova-compute[82184]:     <nova:vcpus>1</nova:vcpus>
Apr 12 01:57:08 user nova-compute[82184]:   </nova:flavor>
Apr 12 01:57:08 user nova-compute[82184]:   <nova:owner>
Apr 12 01:57:08 user nova-compute[82184]:     <nova:user uuid="43819af3565d4eff92ce1a51f86df4f2">tempest-TaggedAttachmentsTest-1804071739-project-member</nova:user>
Apr 12 01:57:08 user nova-compute[82184]:     <nova:project uuid="3443faad6b314920a85b8491603e30ac">tempest-TaggedAttachmentsTest-1804071739</nova:project>
Apr 12 01:57:08 user nova-compute[82184]:   </nova:owner>
Apr 12 01:57:08 user nova-compute[82184]:   <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:57:08 user nova-compute[82184]:   <nova:ports>
Apr 12 01:57:08 user nova-compute[82184]:     <nova:port uuid="0e649e0b-d93b-473c-a765-b0173cea1a6d">
Apr 12 01:57:08 user nova-compute[82184]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 01:57:08 user nova-compute[82184]:     </nova:port>
Apr 12 01:57:08 user nova-compute[82184]:   </nova:ports>
Apr 12 01:57:08 user nova-compute[82184]: </nova:instance>
Apr 12 01:57:08 user nova-compute[82184]:  {{(pid=82184) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 01:57:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98170c8-ff6c-4dbf-bd7d-4fd1034b8642 req-69100215-ce4d-43e4-a969-18d6c6c28234 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-unplugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98170c8-ff6c-4dbf-bd7d-4fd1034b8642 req-69100215-ce4d-43e4-a969-18d6c6c28234 service nova] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98170c8-ff6c-4dbf-bd7d-4fd1034b8642 req-69100215-ce4d-43e4-a969-18d6c6c28234 service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98170c8-ff6c-4dbf-bd7d-4fd1034b8642 req-69100215-ce4d-43e4-a969-18d6c6c28234 service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98170c8-ff6c-4dbf-bd7d-4fd1034b8642 req-69100215-ce4d-43e4-a969-18d6c6c28234 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] No waiting events found dispatching network-vif-unplugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:57:08 user nova-compute[82184]: WARNING nova.compute.manager [req-a98170c8-ff6c-4dbf-bd7d-4fd1034b8642 req-69100215-ce4d-43e4-a969-18d6c6c28234 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received unexpected event network-vif-unplugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 for instance with vm_state active and task_state None.
Apr 12 01:57:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:57:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquired lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:57:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:57:09 user nova-compute[82184]: INFO nova.network.neutron [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Port bb6652b3-90cf-4337-a94b-ca982c4397f5 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 12 01:57:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updating instance_info_cache with network_info: [{"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:57:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Releasing lock "refresh_cache-5b7cbacb-f776-4e9a-b333-ce9c345dc525" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:57:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-fc1ec44d-dd14-4084-938f-553c730b2149 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "interface-5b7cbacb-f776-4e9a-b333-ce9c345dc525-bb6652b3-90cf-4337-a94b-ca982c4397f5" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.186s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-39742746-ffcc-468e-8d06-57d8c56115cb req-5ffb2ced-d65c-4ece-891e-e68f2ee3b92e service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-plugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-39742746-ffcc-468e-8d06-57d8c56115cb req-5ffb2ced-d65c-4ece-891e-e68f2ee3b92e service nova] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-39742746-ffcc-468e-8d06-57d8c56115cb req-5ffb2ced-d65c-4ece-891e-e68f2ee3b92e service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-39742746-ffcc-468e-8d06-57d8c56115cb req-5ffb2ced-d65c-4ece-891e-e68f2ee3b92e service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-39742746-ffcc-468e-8d06-57d8c56115cb req-5ffb2ced-d65c-4ece-891e-e68f2ee3b92e service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] No waiting events found dispatching network-vif-plugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:57:10 user nova-compute[82184]: WARNING nova.compute.manager [req-39742746-ffcc-468e-8d06-57d8c56115cb req-5ffb2ced-d65c-4ece-891e-e68f2ee3b92e service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received unexpected event network-vif-plugged-bb6652b3-90cf-4337-a94b-ca982c4397f5 for instance with vm_state active and task_state None.
Apr 12 01:57:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-39742746-ffcc-468e-8d06-57d8c56115cb req-5ffb2ced-d65c-4ece-891e-e68f2ee3b92e service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-deleted-bb6652b3-90cf-4337-a94b-ca982c4397f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "77f15843-a3a9-4943-a763-0901cd84d7ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:57:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:57:20 user nova-compute[82184]: INFO nova.compute.claims [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Claim successful on node user
Apr 12 01:57:21 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:57:21 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:57:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG nova.policy [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb64ad9101674c1a92d41dfd57ca8e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbc688a91f547c0adbf929d0f714d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:57:21 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Creating image(s)
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "/opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "/opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "/opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk 1073741824" returned: 0 in 0.051s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:57:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:22 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Cannot resize image /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:57:22 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'migration_context' on Instance uuid 77f15843-a3a9-4943-a763-0901cd84d7ca {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:57:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Ensure instance console log exists: /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:57:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:22 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Successfully created port: 00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:57:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Successfully updated port: 00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "refresh_cache-77f15843-a3a9-4943-a763-0901cd84d7ca" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquired lock "refresh_cache-77f15843-a3a9-4943-a763-0901cd84d7ca" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-94ff49c8-a78c-43be-9e45-11661ef40aba req-100ce5d8-b86a-4277-8c48-7ab23cc52218 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Received event network-changed-00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-94ff49c8-a78c-43be-9e45-11661ef40aba req-100ce5d8-b86a-4277-8c48-7ab23cc52218 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Refreshing instance network info cache due to event network-changed-00d413e3-0f38-46cf-baf4-c5b61bbcf104. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-94ff49c8-a78c-43be-9e45-11661ef40aba req-100ce5d8-b86a-4277-8c48-7ab23cc52218 service nova] Acquiring lock "refresh_cache-77f15843-a3a9-4943-a763-0901cd84d7ca" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Updating instance_info_cache with network_info: [{"id": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "address": "fa:16:3e:f6:ce:52", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d413e3-0f", "ovs_interfaceid": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Releasing lock "refresh_cache-77f15843-a3a9-4943-a763-0901cd84d7ca" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Instance network_info: |[{"id": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "address": "fa:16:3e:f6:ce:52", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d413e3-0f", "ovs_interfaceid": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-94ff49c8-a78c-43be-9e45-11661ef40aba req-100ce5d8-b86a-4277-8c48-7ab23cc52218 service nova] Acquired lock "refresh_cache-77f15843-a3a9-4943-a763-0901cd84d7ca" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.network.neutron [req-94ff49c8-a78c-43be-9e45-11661ef40aba req-100ce5d8-b86a-4277-8c48-7ab23cc52218 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Refreshing network info cache for port 00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Start _get_guest_xml network_info=[{"id": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "address": "fa:16:3e:f6:ce:52", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d413e3-0f", "ovs_interfaceid": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:57:23 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:57:23 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1188952548',display_name='tempest-VolumesSnapshotTestJSON-instance-1188952548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1188952548',id=20,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dbc688a91f547c0adbf929d0f714d51',ramdisk_id='',reservation_id='r-m9hkbtwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1019440197',owner_user_name='tempest-VolumesSnapshotTestJSON-1019440197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:57:21Z,user_data=None,user_id='cb64ad9101674c1a92d41dfd57ca8e15',uuid=77f15843-a3a9-4943-a763-0901cd84d7ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "address": "fa:16:3e:f6:ce:52", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d413e3-0f", "ovs_interfaceid": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converting VIF {"id": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "address": "fa:16:3e:f6:ce:52", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d413e3-0f", "ovs_interfaceid": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=00d413e3-0f38-46cf-baf4-c5b61bbcf104,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d413e3-0f') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'pci_devices' on Instance uuid 77f15843-a3a9-4943-a763-0901cd84d7ca {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:57:23 user nova-compute[82184]:   <uuid>77f15843-a3a9-4943-a763-0901cd84d7ca</uuid>
Apr 12 01:57:23 user nova-compute[82184]:   <name>instance-00000014</name>
Apr 12 01:57:23 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:57:23 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:57:23 user nova-compute[82184]:   <metadata>
Apr 12 01:57:23 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:57:23 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:57:23 user nova-compute[82184]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1188952548</nova:name>
Apr 12 01:57:23 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:57:23</nova:creationTime>
Apr 12 01:57:23 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:57:23 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:57:23 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:57:23 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:57:23 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:57:23 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:57:23 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:57:23 user nova-compute[82184]:       <nova:owner>
Apr 12 01:57:23 user nova-compute[82184]:         <nova:user uuid="cb64ad9101674c1a92d41dfd57ca8e15">tempest-VolumesSnapshotTestJSON-1019440197-project-member</nova:user>
Apr 12 01:57:23 user nova-compute[82184]:         <nova:project uuid="1dbc688a91f547c0adbf929d0f714d51">tempest-VolumesSnapshotTestJSON-1019440197</nova:project>
Apr 12 01:57:23 user nova-compute[82184]:       </nova:owner>
Apr 12 01:57:23 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:57:23 user nova-compute[82184]:       <nova:ports>
Apr 12 01:57:23 user nova-compute[82184]:         <nova:port uuid="00d413e3-0f38-46cf-baf4-c5b61bbcf104">
Apr 12 01:57:23 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 01:57:23 user nova-compute[82184]:         </nova:port>
Apr 12 01:57:23 user nova-compute[82184]:       </nova:ports>
Apr 12 01:57:23 user nova-compute[82184]:     </nova:instance>
Apr 12 01:57:23 user nova-compute[82184]:   </metadata>
Apr 12 01:57:23 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:57:23 user nova-compute[82184]:     <system>
Apr 12 01:57:23 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:57:23 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:57:23 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:57:23 user nova-compute[82184]:       <entry name="serial">77f15843-a3a9-4943-a763-0901cd84d7ca</entry>
Apr 12 01:57:23 user nova-compute[82184]:       <entry name="uuid">77f15843-a3a9-4943-a763-0901cd84d7ca</entry>
Apr 12 01:57:23 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:57:23 user nova-compute[82184]:     </system>
Apr 12 01:57:23 user nova-compute[82184]:   </sysinfo>
Apr 12 01:57:23 user nova-compute[82184]:   <os>
Apr 12 01:57:23 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:57:23 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:57:23 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:57:23 user nova-compute[82184]:   </os>
Apr 12 01:57:23 user nova-compute[82184]:   <features>
Apr 12 01:57:23 user nova-compute[82184]:     <acpi/>
Apr 12 01:57:23 user nova-compute[82184]:     <apic/>
Apr 12 01:57:23 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:57:23 user nova-compute[82184]:   </features>
Apr 12 01:57:23 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:57:23 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:57:23 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:57:23 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:57:23 user nova-compute[82184]:   </clock>
Apr 12 01:57:23 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:57:23 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:57:23 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:57:23 user nova-compute[82184]:   </cpu>
Apr 12 01:57:23 user nova-compute[82184]:   <devices>
Apr 12 01:57:23 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:57:23 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:57:23 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk"/>
Apr 12 01:57:23 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:57:23 user nova-compute[82184]:     </disk>
Apr 12 01:57:23 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:57:23 user nova-compute[82184]:       <mac address="fa:16:3e:f6:ce:52"/>
Apr 12 01:57:23 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:57:23 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:57:23 user nova-compute[82184]:       <target dev="tap00d413e3-0f"/>
Apr 12 01:57:23 user nova-compute[82184]:     </interface>
Apr 12 01:57:23 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:57:23 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/console.log" append="off"/>
Apr 12 01:57:23 user nova-compute[82184]:     </serial>
Apr 12 01:57:23 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:57:23 user nova-compute[82184]:     <video>
Apr 12 01:57:23 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:57:23 user nova-compute[82184]:     </video>
Apr 12 01:57:23 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:57:23 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:57:23 user nova-compute[82184]:     </rng>
Apr 12 01:57:23 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:57:23 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:57:23 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:57:23 user nova-compute[82184]:     </memballoon>
Apr 12 01:57:23 user nova-compute[82184]:   </devices>
Apr 12 01:57:23 user nova-compute[82184]: </domain>
Apr 12 01:57:23 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1188952548',display_name='tempest-VolumesSnapshotTestJSON-instance-1188952548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1188952548',id=20,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dbc688a91f547c0adbf929d0f714d51',ramdisk_id='',reservation_id='r-m9hkbtwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1019440197',owner_user_name='tempest-VolumesSnapshotTestJSON-1019440197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:57:21Z,user_data=None,user_id='cb64ad9101674c1a92d41dfd57ca8e15',uuid=77f15843-a3a9-4943-a763-0901cd84d7ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "address": "fa:16:3e:f6:ce:52", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d413e3-0f", "ovs_interfaceid": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converting VIF {"id": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "address": "fa:16:3e:f6:ce:52", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d413e3-0f", "ovs_interfaceid": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=00d413e3-0f38-46cf-baf4-c5b61bbcf104,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d413e3-0f') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG os_vif [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=00d413e3-0f38-46cf-baf4-c5b61bbcf104,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d413e3-0f') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00d413e3-0f, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00d413e3-0f, col_values=(('external_ids', {'iface-id': '00d413e3-0f38-46cf-baf4-c5b61bbcf104', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:ce:52', 'vm-uuid': '77f15843-a3a9-4943-a763-0901cd84d7ca'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:23 user nova-compute[82184]: INFO os_vif [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=00d413e3-0f38-46cf-baf4-c5b61bbcf104,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d413e3-0f')
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:57:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] No VIF found with MAC fa:16:3e:f6:ce:52, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:57:24 user nova-compute[82184]: DEBUG nova.network.neutron [req-94ff49c8-a78c-43be-9e45-11661ef40aba req-100ce5d8-b86a-4277-8c48-7ab23cc52218 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Updated VIF entry in instance network info cache for port 00d413e3-0f38-46cf-baf4-c5b61bbcf104. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:57:24 user nova-compute[82184]: DEBUG nova.network.neutron [req-94ff49c8-a78c-43be-9e45-11661ef40aba req-100ce5d8-b86a-4277-8c48-7ab23cc52218 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Updating instance_info_cache with network_info: [{"id": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "address": "fa:16:3e:f6:ce:52", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d413e3-0f", "ovs_interfaceid": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:57:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-94ff49c8-a78c-43be-9e45-11661ef40aba req-100ce5d8-b86a-4277-8c48-7ab23cc52218 service nova] Releasing lock "refresh_cache-77f15843-a3a9-4943-a763-0901cd84d7ca" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:57:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-c3a82d7b-ab56-4152-b778-631a72e219c0 req-e6f3c4df-6922-4bd7-92ad-f0ee52477247 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Received event network-vif-plugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c3a82d7b-ab56-4152-b778-631a72e219c0 req-e6f3c4df-6922-4bd7-92ad-f0ee52477247 service nova] Acquiring lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c3a82d7b-ab56-4152-b778-631a72e219c0 req-e6f3c4df-6922-4bd7-92ad-f0ee52477247 service nova] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c3a82d7b-ab56-4152-b778-631a72e219c0 req-e6f3c4df-6922-4bd7-92ad-f0ee52477247 service nova] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-c3a82d7b-ab56-4152-b778-631a72e219c0 req-e6f3c4df-6922-4bd7-92ad-f0ee52477247 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] No waiting events found dispatching network-vif-plugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:57:25 user nova-compute[82184]: WARNING nova.compute.manager [req-c3a82d7b-ab56-4152-b778-631a72e219c0 req-e6f3c4df-6922-4bd7-92ad-f0ee52477247 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Received unexpected event network-vif-plugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 for instance with vm_state building and task_state spawning.
Apr 12 01:57:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264647.4988906, 77f15843-a3a9-4943-a763-0901cd84d7ca => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:57:27 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] VM Resumed (Lifecycle Event)
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:57:27 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Instance spawned successfully.
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:57:27 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264647.5000818, 77f15843-a3a9-4943-a763-0901cd84d7ca => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:57:27 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] VM Started (Lifecycle Event)
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:57:27 user nova-compute[82184]: INFO nova.compute.manager [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Took 6.15 seconds to spawn the instance on the hypervisor.
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:57:27 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:57:27 user nova-compute[82184]: INFO nova.compute.manager [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Took 6.82 seconds to build instance.
Apr 12 01:57:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b483a6d4-e138-4d50-a6bd-fdbb902606d5 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.910s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-9b6eedd9-7504-42c1-8d6e-edd483a255fd req-083db390-0006-4fb8-bd9e-ea890b4191e5 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Received event network-vif-plugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9b6eedd9-7504-42c1-8d6e-edd483a255fd req-083db390-0006-4fb8-bd9e-ea890b4191e5 service nova] Acquiring lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9b6eedd9-7504-42c1-8d6e-edd483a255fd req-083db390-0006-4fb8-bd9e-ea890b4191e5 service nova] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9b6eedd9-7504-42c1-8d6e-edd483a255fd req-083db390-0006-4fb8-bd9e-ea890b4191e5 service nova] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-9b6eedd9-7504-42c1-8d6e-edd483a255fd req-083db390-0006-4fb8-bd9e-ea890b4191e5 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] No waiting events found dispatching network-vif-plugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:57:27 user nova-compute[82184]: WARNING nova.compute.manager [req-9b6eedd9-7504-42c1-8d6e-edd483a255fd req-083db390-0006-4fb8-bd9e-ea890b4191e5 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Received unexpected event network-vif-plugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 for instance with vm_state active and task_state None.
Apr 12 01:57:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquired lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'info_cache' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.network.neutron [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updating instance_info_cache with network_info: [{"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Releasing lock "refresh_cache-cb89325c-680a-4413-8e94-4eddfaa79c6b" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:57:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance destroyed successfully.
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'resources' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-682748151',display_name='tempest-AttachVolumeTestJSON-server-682748151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-682748151',id=6,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2NTbVfrYVAmPq/WSiXNxhw73D4U473knUSj3S2SzGG67zJUMcYD7NdTMJnRymKmrJWRxrjStG5itGjTKaX5Cd+wZw4hLfWVikFnVEIrbrRCuVHjjCnBxwGGHScYXLHw==',key_name='tempest-keypair-663896141',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-n3kypybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=cb89325c-680a-4413-8e94-4eddfaa79c6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG os_vif [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec368fc5-6d, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:57:33 user nova-compute[82184]: INFO os_vif [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d')
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Start _get_guest_xml network_info=[{"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'numa_topology' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:33 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:57:33 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'vcpu_model' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-682748151',display_name='tempest-AttachVolumeTestJSON-server-682748151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-682748151',id=6,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2NTbVfrYVAmPq/WSiXNxhw73D4U473knUSj3S2SzGG67zJUMcYD7NdTMJnRymKmrJWRxrjStG5itGjTKaX5Cd+wZw4hLfWVikFnVEIrbrRCuVHjjCnBxwGGHScYXLHw==',key_name='tempest-keypair-663896141',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-n3kypybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=cb89325c-680a-4413-8e94-4eddfaa79c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'pci_devices' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:57:33 user nova-compute[82184]:   <uuid>cb89325c-680a-4413-8e94-4eddfaa79c6b</uuid>
Apr 12 01:57:33 user nova-compute[82184]:   <name>instance-00000006</name>
Apr 12 01:57:33 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:57:33 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:57:33 user nova-compute[82184]:   <metadata>
Apr 12 01:57:33 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:57:33 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:57:33 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeTestJSON-server-682748151</nova:name>
Apr 12 01:57:33 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:57:33</nova:creationTime>
Apr 12 01:57:33 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:57:33 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:57:33 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:57:33 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:57:33 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:57:33 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:57:33 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:57:33 user nova-compute[82184]:       <nova:owner>
Apr 12 01:57:33 user nova-compute[82184]:         <nova:user uuid="d2ca4855c3e9461cb27c88469086d7d8">tempest-AttachVolumeTestJSON-913560355-project-member</nova:user>
Apr 12 01:57:33 user nova-compute[82184]:         <nova:project uuid="c34bd636a2a54b249dca9ce9027ebf4b">tempest-AttachVolumeTestJSON-913560355</nova:project>
Apr 12 01:57:33 user nova-compute[82184]:       </nova:owner>
Apr 12 01:57:33 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:57:33 user nova-compute[82184]:       <nova:ports>
Apr 12 01:57:33 user nova-compute[82184]:         <nova:port uuid="ec368fc5-6d05-4bab-8460-cf9f1e024195">
Apr 12 01:57:33 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 01:57:33 user nova-compute[82184]:         </nova:port>
Apr 12 01:57:33 user nova-compute[82184]:       </nova:ports>
Apr 12 01:57:33 user nova-compute[82184]:     </nova:instance>
Apr 12 01:57:33 user nova-compute[82184]:   </metadata>
Apr 12 01:57:33 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:57:33 user nova-compute[82184]:     <system>
Apr 12 01:57:33 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:57:33 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:57:33 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:57:33 user nova-compute[82184]:       <entry name="serial">cb89325c-680a-4413-8e94-4eddfaa79c6b</entry>
Apr 12 01:57:33 user nova-compute[82184]:       <entry name="uuid">cb89325c-680a-4413-8e94-4eddfaa79c6b</entry>
Apr 12 01:57:33 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:57:33 user nova-compute[82184]:     </system>
Apr 12 01:57:33 user nova-compute[82184]:   </sysinfo>
Apr 12 01:57:33 user nova-compute[82184]:   <os>
Apr 12 01:57:33 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:57:33 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:57:33 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:57:33 user nova-compute[82184]:   </os>
Apr 12 01:57:33 user nova-compute[82184]:   <features>
Apr 12 01:57:33 user nova-compute[82184]:     <acpi/>
Apr 12 01:57:33 user nova-compute[82184]:     <apic/>
Apr 12 01:57:33 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:57:33 user nova-compute[82184]:   </features>
Apr 12 01:57:33 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:57:33 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:57:33 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:57:33 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:57:33 user nova-compute[82184]:   </clock>
Apr 12 01:57:33 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:57:33 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:57:33 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:57:33 user nova-compute[82184]:   </cpu>
Apr 12 01:57:33 user nova-compute[82184]:   <devices>
Apr 12 01:57:33 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:57:33 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:57:33 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk"/>
Apr 12 01:57:33 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:57:33 user nova-compute[82184]:     </disk>
Apr 12 01:57:33 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:57:33 user nova-compute[82184]:       <mac address="fa:16:3e:9d:cb:06"/>
Apr 12 01:57:33 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:57:33 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:57:33 user nova-compute[82184]:       <target dev="tapec368fc5-6d"/>
Apr 12 01:57:33 user nova-compute[82184]:     </interface>
Apr 12 01:57:33 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:57:33 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/console.log" append="off"/>
Apr 12 01:57:33 user nova-compute[82184]:     </serial>
Apr 12 01:57:33 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:57:33 user nova-compute[82184]:     <video>
Apr 12 01:57:33 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:57:33 user nova-compute[82184]:     </video>
Apr 12 01:57:33 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:57:33 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:57:33 user nova-compute[82184]:     </rng>
Apr 12 01:57:33 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:57:33 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:57:33 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:57:33 user nova-compute[82184]:     </memballoon>
Apr 12 01:57:33 user nova-compute[82184]:   </devices>
Apr 12 01:57:33 user nova-compute[82184]: </domain>
Apr 12 01:57:33 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:57:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG nova.objects.instance [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'trusted_certs' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Cannot resize image /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG nova.objects.instance [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'migration_context' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-682748151',display_name='tempest-AttachVolumeTestJSON-server-682748151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-682748151',id=6,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2NTbVfrYVAmPq/WSiXNxhw73D4U473knUSj3S2SzGG67zJUMcYD7NdTMJnRymKmrJWRxrjStG5itGjTKaX5Cd+wZw4hLfWVikFnVEIrbrRCuVHjjCnBxwGGHScYXLHw==',key_name='tempest-keypair-663896141',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-n3kypybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=cb89325c-680a-4413-8e94-4eddfaa79c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG os_vif [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec368fc5-6d, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec368fc5-6d, col_values=(('external_ids', {'iface-id': 'ec368fc5-6d05-4bab-8460-cf9f1e024195', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:cb:06', 'vm-uuid': 'cb89325c-680a-4413-8e94-4eddfaa79c6b'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:57:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:34 user nova-compute[82184]: INFO os_vif [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d')
Apr 12 01:57:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-883f9495-dc79-4d31-942c-bdbab6177616 req-7f0c47d6-d347-411b-8e13-e83d593e63e3 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-883f9495-dc79-4d31-942c-bdbab6177616 req-7f0c47d6-d347-411b-8e13-e83d593e63e3 service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-883f9495-dc79-4d31-942c-bdbab6177616 req-7f0c47d6-d347-411b-8e13-e83d593e63e3 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-883f9495-dc79-4d31-942c-bdbab6177616 req-7f0c47d6-d347-411b-8e13-e83d593e63e3 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-883f9495-dc79-4d31-942c-bdbab6177616 req-7f0c47d6-d347-411b-8e13-e83d593e63e3 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:57:36 user nova-compute[82184]: WARNING nova.compute.manager [req-883f9495-dc79-4d31-942c-bdbab6177616 req-7f0c47d6-d347-411b-8e13-e83d593e63e3 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state stopped and task_state powering-on.
Apr 12 01:57:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:38 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264658.0348175, cb89325c-680a-4413-8e94-4eddfaa79c6b => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:57:38 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] VM Resumed (Lifecycle Event)
Apr 12 01:57:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:57:38 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance rebooted successfully.
Apr 12 01:57:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c92635c6-b1bb-475f-95df-aec9664c414b tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:57:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:57:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:57:38 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 01:57:38 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264658.037375, cb89325c-680a-4413-8e94-4eddfaa79c6b => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:57:38 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] VM Started (Lifecycle Event)
Apr 12 01:57:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:57:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:57:38 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 01:57:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-3e1445c7-eca2-404c-81dc-a23dad43d32c req-f7f8f479-b664-4cfc-95ef-753e1850b762 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3e1445c7-eca2-404c-81dc-a23dad43d32c req-f7f8f479-b664-4cfc-95ef-753e1850b762 service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3e1445c7-eca2-404c-81dc-a23dad43d32c req-f7f8f479-b664-4cfc-95ef-753e1850b762 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3e1445c7-eca2-404c-81dc-a23dad43d32c req-f7f8f479-b664-4cfc-95ef-753e1850b762 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-3e1445c7-eca2-404c-81dc-a23dad43d32c req-f7f8f479-b664-4cfc-95ef-753e1850b762 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:57:38 user nova-compute[82184]: WARNING nova.compute.manager [req-3e1445c7-eca2-404c-81dc-a23dad43d32c req-f7f8f479-b664-4cfc-95ef-753e1850b762 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state stopped and task_state powering-on.
Apr 12 01:57:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:45 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:57:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:57:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:49 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:57:49 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=7588MB free_disk=26.430156707763672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cb89325c-680a-4413-8e94-4eddfaa79c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 39c1ed52-fe5b-4e57-854a-36476bdb215c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3827c534-7f4a-4f22-bf88-91e8897c6285 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 77f15843-a3a9-4943-a763-0901cd84d7ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:57:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'flavor' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:50 user nova-compute[82184]: INFO nova.compute.manager [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Attaching volume cf91b105-163e-4c1d-a936-6939ccb3db3f to /dev/vdb
Apr 12 01:57:50 user nova-compute[82184]: DEBUG os_brick.utils [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[367ca34f-73d0-4afa-8ae4-2ac592623254]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[738553a5-f6db-4a45-9146-da9246839022]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e339754-a8a1-44af-a584-791556c01d70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f5d5e4-0d9f-4fce-95c5-c5380d046958]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:57:50 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:57:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a114a3-ae71-4002-a035-858e9761ea7a]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG os_brick.utils [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:57:50 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating existing volume attachment record: 1738326f-2184-4258-9c48-0b9a898d15a1 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updating instance_info_cache with network_info: [{"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:57:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYdskMbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:57:54 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:57:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:57:54 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:57:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:57:54 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[050083f0-b11e-4968-96d3-f05aa8b385f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:57:54 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf661c7-d676-4a64-bcfc-db881d56b42e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f] added
Apr 12 01:57:54 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2bb6e2-2f75-4a03-860a-6041ab11c412]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b9f8da-a459-4f57-8edf-e0ef71d456eb]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYdskMbm {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYdskMbm" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd03646-c8a5-40d1-9562-aa46f3d81a6e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cYdskMbm'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c0fd48-a330-4458-9abb-d32c5c860992]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f856ce-b5ae-4c1e-bd4d-092ba1e17e66]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:57:55 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 01:57:55 user nova-compute[82184]:  {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:57:55 user nova-compute[82184]: WARNING os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 01:57:55 user nova-compute[82184]: 
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec9071-a1d5-42d1-bc63-645d6d39449c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f, portal: 172.16.0.220,3260]
Apr 12 01:57:55 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f, portal: 172.16.0.220,3260] successful.
Apr 12 01:57:55 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d851a26-51d4-49a8-bd6c-84953d3e8d03]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4525fe0e-3de2-4dbb-aa43-feeca9d9a7f6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:57:55 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:57:55 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab8649f-c603-411a-b6df-5065f2161306]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:57:55 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYdskMbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26332343434336562', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332343434336562', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'flavor' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:57:56 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:57:56 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 01:57:56 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:57:56 user nova-compute[82184]:   <serial>cf91b105-163e-4c1d-a936-6939ccb3db3f</serial>
Apr 12 01:57:56 user nova-compute[82184]: </disk>
Apr 12 01:57:56 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] No VIF found with MAC fa:16:3e:f4:60:ca, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:57:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e74cb50a-432b-4e45-8b69-1ec56b60fdd2 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.224s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:57 user nova-compute[82184]: INFO nova.compute.manager [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Rescuing
Apr 12 01:57:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:57:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquired lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:57:57 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:57:57 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating instance_info_cache with network_info: [{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:57:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Releasing lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-daba229b-9b82-4837-b35b-8c7f5bb65a27 req-7b197acb-038a-44ed-b567-6c7e4c38bf7d service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-daba229b-9b82-4837-b35b-8c7f5bb65a27 req-7b197acb-038a-44ed-b567-6c7e4c38bf7d service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-daba229b-9b82-4837-b35b-8c7f5bb65a27 req-7b197acb-038a-44ed-b567-6c7e4c38bf7d service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-daba229b-9b82-4837-b35b-8c7f5bb65a27 req-7b197acb-038a-44ed-b567-6c7e4c38bf7d service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-daba229b-9b82-4837-b35b-8c7f5bb65a27 req-7b197acb-038a-44ed-b567-6c7e4c38bf7d service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:57:58 user nova-compute[82184]: WARNING nova.compute.manager [req-daba229b-9b82-4837-b35b-8c7f5bb65a27 req-7b197acb-038a-44ed-b567-6c7e4c38bf7d service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state active and task_state rescuing.
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:58 user nova-compute[82184]: INFO nova.compute.manager [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Terminating instance
Apr 12 01:57:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:58 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Instance destroyed successfully.
Apr 12 01:57:58 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Attempting a stable device rescue
Apr 12 01:57:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=82184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Instance directory exists: not creating {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 01:57:58 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Creating image(s)
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "1103d5c417a34a44967ed796c77ea479389209f7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "1103d5c417a34a44967ed796c77ea479389209f7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-d35801a0-4365-4f4e-b790-9c8e499911de req-687274e6-8f92-4c6a-b92e-b6a6f48ab9e2 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-unplugged-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d35801a0-4365-4f4e-b790-9c8e499911de req-687274e6-8f92-4c6a-b92e-b6a6f48ab9e2 service nova] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d35801a0-4365-4f4e-b790-9c8e499911de req-687274e6-8f92-4c6a-b92e-b6a6f48ab9e2 service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d35801a0-4365-4f4e-b790-9c8e499911de req-687274e6-8f92-4c6a-b92e-b6a6f48ab9e2 service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-d35801a0-4365-4f4e-b790-9c8e499911de req-687274e6-8f92-4c6a-b92e-b6a6f48ab9e2 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] No waiting events found dispatching network-vif-unplugged-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:57:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-d35801a0-4365-4f4e-b790-9c8e499911de req-687274e6-8f92-4c6a-b92e-b6a6f48ab9e2 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-unplugged-0e649e0b-d93b-473c-a765-b0173cea1a6d for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7.part --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:59 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Instance destroyed successfully.
Apr 12 01:57:59 user nova-compute[82184]: DEBUG nova.objects.instance [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lazy-loading 'resources' on Instance uuid 5b7cbacb-f776-4e9a-b333-ce9c345dc525 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T01:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-211209472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-211209472',id=17,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlxYLGiDT3ULykrJ/16FAYLe9mlS7WpoHsNkE+Oww0i5S0/0HEU1ZMf1BlJ8O7u24iaXO1qwL8Qcg5/TeN5uRr2keoVwu2xaLtJctivU4Ipg77M6FqVNyx8y2JxOGS9rQ==',key_name='tempest-keypair-1476535441',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:55:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3443faad6b314920a85b8491603e30ac',ramdisk_id='',reservation_id='r-jpcow580',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1804071739',owner_user_name='tempest-TaggedAttachmentsTest-1804071739-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43819af3565d4eff92ce1a51f86df4f2',uuid=5b7cbacb-f776-4e9a-b333-ce9c345dc525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converting VIF {"id": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "address": "fa:16:3e:11:a5:b3", "network": {"id": "988b3410-7746-4c36-99ce-5bab176cefe3", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044752811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3443faad6b314920a85b8491603e30ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e649e0b-d9", "ovs_interfaceid": "0e649e0b-d93b-473c-a765-b0173cea1a6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:a5:b3,bridge_name='br-int',has_traffic_filtering=True,id=0e649e0b-d93b-473c-a765-b0173cea1a6d,network=Network(988b3410-7746-4c36-99ce-5bab176cefe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e649e0b-d9') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG os_vif [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:a5:b3,bridge_name='br-int',has_traffic_filtering=True,id=0e649e0b-d93b-473c-a765-b0173cea1a6d,network=Network(988b3410-7746-4c36-99ce-5bab176cefe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e649e0b-d9') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e649e0b-d9, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:57:59 user nova-compute[82184]: INFO os_vif [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:a5:b3,bridge_name='br-int',has_traffic_filtering=True,id=0e649e0b-d93b-473c-a765-b0173cea1a6d,network=Network(988b3410-7746-4c36-99ce-5bab176cefe3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e649e0b-d9')
Apr 12 01:57:59 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Deleting instance files /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525_del
Apr 12 01:57:59 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Deletion of /opt/stack/data/nova/instances/5b7cbacb-f776-4e9a-b333-ce9c345dc525_del complete
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7.part --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG nova.virt.images [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] 37146b86-9ec3-440f-95de-7bf8ac2dd966 was qcow2, converting to raw {{(pid=82184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7.part /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7.converted {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:59 user nova-compute[82184]: INFO nova.compute.manager [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7.part /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7.converted" returned: 0 in 0.183s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7.converted --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "1103d5c417a34a44967ed796c77ea479389209f7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.132s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "1103d5c417a34a44967ed796c77ea479389209f7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "1103d5c417a34a44967ed796c77ea479389209f7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:57:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7 --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7,backing_fmt=raw /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7,backing_fmt=raw /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue" returned: 0 in 0.044s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "1103d5c417a34a44967ed796c77ea479389209f7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'migration_context' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Start _get_guest_xml network_info=[{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "vif_mac": "fa:16:3e:f4:60:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '37146b86-9ec3-440f-95de-7bf8ac2dd966', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': '1738326f-2184-4258-9c48-0b9a898d15a1', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYdskMbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0d49cd12-9b4d-4a93-ad5f-bbf0536d5959', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf91b105-163e-4c1d-a936-6939ccb3db3f', 'serial': 'cf91b105-163e-4c1d-a936-6939ccb3db3f'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'resources' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'numa_topology' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:00 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:58:00 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYdskMbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:58:00 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:58:00 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:58:00 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[701438a2-d5dd-40e0-9f81-4214879564fe]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cYdskMbm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 01:58:00 user nova-compute[82184]: node.name = iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f
Apr 12 01:58:00 user nova-compute[82184]: node.tpgt = -1
Apr 12 01:58:00 user nova-compute[82184]: node.startup = automatic
Apr 12 01:58:00 user nova-compute[82184]: node.leading_login = No
Apr 12 01:58:00 user nova-compute[82184]: iface.iscsi_ifacename = default
Apr 12 01:58:00 user nova-compute[82184]: iface.net_ifacename = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.ipaddress = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.prefix_len = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.hwaddress = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.transport_name = tcp
Apr 12 01:58:00 user nova-compute[82184]: iface.initiatorname = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.state = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.vlan_id = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.vlan_priority = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.vlan_state = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.iface_num = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.mtu = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.port = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.bootproto = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.subnet_mask = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.gateway = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.dhcp_alt_client_id = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.dhcp_dns = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.dhcp_learn_iqn = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.dhcp_vendor_id_state = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.dhcp_vendor_id = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.dhcp_slp_da = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.fragmentation = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.gratuitous_arp = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.incoming_forwarding = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.tos_state = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.tos = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.ttl = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.delayed_ack = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.tcp_nagle = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.tcp_wsf_state = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.tcp_wsf = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.tcp_timer_scale = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.tcp_timestamp = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.redirect = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.def_task_mgmt_timeout = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.header_digest = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.data_digest = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.immediate_data = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.initial_r2t = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.data_seq_inorder = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.data_pdu_inorder = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.erl = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.max_receive_data_len = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.first_burst_len = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.max_outstanding_r2t = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.max_burst_len = 0
Apr 12 01:58:00 user nova-compute[82184]: iface.chap_auth = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.bidi_chap = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.strict_login_compliance = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.discovery_auth = <empty>
Apr 12 01:58:00 user nova-compute[82184]: iface.discovery_logout = <empty>
Apr 12 01:58:00 user nova-compute[82184]: node.discovery_address = <empty>
Apr 12 01:58:00 user nova-compute[82184]: node.discovery_port = 0
Apr 12 01:58:00 user nova-compute[82184]: node.discovery_type = static
Apr 12 01:58:00 user nova-compute[82184]: node.session.initial_cmdsn = 0
Apr 12 01:58:00 user nova-compute[82184]: node.session.initial_login_retry_max = 8
Apr 12 01:58:00 user nova-compute[82184]: node.session.xmit_thread_priority = -20
Apr 12 01:58:00 user nova-compute[82184]: node.session.cmds_max = 128
Apr 12 01:58:00 user nova-compute[82184]: node.session.queue_depth = 32
Apr 12 01:58:00 user nova-compute[82184]: node.session.nr_sessions = 1
Apr 12 01:58:00 user nova-compute[82184]: node.session.auth.authmethod = CHAP
Apr 12 01:58:00 user nova-compute[82184]: node.session.auth.username = cYdskMbm
Apr 12 01:58:00 user nova-compute[82184]: node.session.auth.password = ***
Apr 12 01:58:00 user nova-compute[82184]: node.session.auth.username_in = <empty>
Apr 12 01:58:00 user nova-compute[82184]: node.session.auth.password_in = <empty>
Apr 12 01:58:00 user nova-compute[82184]: node.session.auth.chap_algs = MD5
Apr 12 01:58:00 user nova-compute[82184]: node.session.timeo.replacement_timeout = 120
Apr 12 01:58:00 user nova-compute[82184]: node.session.err_timeo.abort_timeout = 15
Apr 12 01:58:00 user nova-compute[82184]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 01:58:00 user nova-compute[82184]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 01:58:00 user nova-compute[82184]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 01:58:00 user nova-compute[82184]: node.session.iscsi.FastAbort = Yes
Apr 12 01:58:00 user nova-compute[82184]: node.session.iscsi.InitialR2T = No
Apr 12 01:58:00 user nova-compute[82184]: node.session.iscsi.ImmediateData = Yes
Apr 12 01:58:00 user nova-compute[82184]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 01:58:00 user nova-compute[82184]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 01:58:00 user nova-compute[82184]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 01:58:00 user nova-compute[82184]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 01:58:00 user nova-compute[82184]: node.session.iscsi.MaxConnections = 1
Apr 12 01:58:00 user nova-compute[82184]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 01:58:00 user nova-compute[82184]: node.session.iscsi.ERL = 0
Apr 12 01:58:00 user nova-compute[82184]: node.session.scan = manual
Apr 12 01:58:00 user nova-compute[82184]: node.session.reopen_max = 0
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].address = 172.16.0.220
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].port = 3260
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].startup = manual
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].tcp.window_size = 524288
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].tcp.type_of_service = 0
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].timeo.logout_timeout = 15
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].timeo.login_timeout = 15
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].timeo.auth_timeout = 45
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].iscsi.DataDigest = None
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].iscsi.IFMarker = No
Apr 12 01:58:00 user nova-compute[82184]: node.conn[0].iscsi.OFMarker = No
Apr 12 01:58:00 user nova-compute[82184]: # END RECORD
Apr 12 01:58:00 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-cff599ae-c8dc-4184-b747-8da8df57a886 req-39219a44-2e1b-406d-bd40-8abb35fc8a8a service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cff599ae-c8dc-4184-b747-8da8df57a886 req-39219a44-2e1b-406d-bd40-8abb35fc8a8a service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cff599ae-c8dc-4184-b747-8da8df57a886 req-39219a44-2e1b-406d-bd40-8abb35fc8a8a service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cff599ae-c8dc-4184-b747-8da8df57a886 req-39219a44-2e1b-406d-bd40-8abb35fc8a8a service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-cff599ae-c8dc-4184-b747-8da8df57a886 req-39219a44-2e1b-406d-bd40-8abb35fc8a8a service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:00 user nova-compute[82184]: WARNING nova.compute.manager [req-cff599ae-c8dc-4184-b747-8da8df57a886 req-39219a44-2e1b-406d-bd40-8abb35fc8a8a service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state active and task_state rescuing.
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5266f621-f6f2-4892-a971-6ace2f479737]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e96ee3-904d-4ea3-b908-fa292672cf9b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYdskMbm {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYdskMbm" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9465e0-dc22-4603-9ee5-c40d0238b308]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cYdskMbm'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9fc6cf-ce28-4b9e-88f0-3c573bbe077f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d766ba93-1049-4eb0-b2d9-a7d50573924b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:00 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:00 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.142s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] HCTL ('33', '0', '0', 0) found on session 19 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[159931ec-3472-4e94-a6b2-0b73f020e4a8]: (4, ('0 0 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Searching for a device in session 19 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYdskMbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.164s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] <== connect_volume: return (166ms) {'type': 'block', 'scsi_wwn': '26332343434336562', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332343434336562', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1700354406',display_name='tempest-ServerStableDeviceRescueTest-server-1700354406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1700354406',id=16,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI/RFUfuZXI6dJ1hjD1JW2D0k8xZh+epQO+5dsrL15C9zRJbRnL07EyJ7CDIspWuf9JFtZqO5PUPIpDarEwCZLJxygT+Ba5rtS558RsdJ4Kzf5y9GMjIllAHF5H0rE0pA==',key_name='tempest-keypair-682814124',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:54:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdf7e36a5e4b44f690f875999b4b101a',ramdisk_id='',reservation_id='r-00qom6go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1741311402',owner_user_name='tempest-ServerStableDeviceRescueTest-1741311402-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:56:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6c9d8100d504d1c8437b627f5564e33',uuid=0d49cd12-9b4d-4a93-ad5f-bbf0536d5959,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "vif_mac": "fa:16:3e:f4:60:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Converting VIF {"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "vif_mac": "fa:16:3e:f4:60:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:60:ca,bridge_name='br-int',has_traffic_filtering=True,id=77c37f41-cbd9-4b96-a5e7-103d187fce32,network=Network(849f67cf-2fe1-4792-ac08-a770ab4435c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c37f41-cb') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:58:00 user nova-compute[82184]:   <uuid>0d49cd12-9b4d-4a93-ad5f-bbf0536d5959</uuid>
Apr 12 01:58:00 user nova-compute[82184]:   <name>instance-00000010</name>
Apr 12 01:58:00 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:58:00 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:58:00 user nova-compute[82184]:   <metadata>
Apr 12 01:58:00 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:58:00 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:58:00 user nova-compute[82184]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1700354406</nova:name>
Apr 12 01:58:00 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:58:00</nova:creationTime>
Apr 12 01:58:00 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:58:00 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:58:00 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:58:00 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:58:00 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:58:00 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:58:00 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:58:00 user nova-compute[82184]:       <nova:owner>
Apr 12 01:58:00 user nova-compute[82184]:         <nova:user uuid="e6c9d8100d504d1c8437b627f5564e33">tempest-ServerStableDeviceRescueTest-1741311402-project-member</nova:user>
Apr 12 01:58:00 user nova-compute[82184]:         <nova:project uuid="cdf7e36a5e4b44f690f875999b4b101a">tempest-ServerStableDeviceRescueTest-1741311402</nova:project>
Apr 12 01:58:00 user nova-compute[82184]:       </nova:owner>
Apr 12 01:58:00 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:58:00 user nova-compute[82184]:       <nova:ports>
Apr 12 01:58:00 user nova-compute[82184]:         <nova:port uuid="77c37f41-cbd9-4b96-a5e7-103d187fce32">
Apr 12 01:58:00 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 01:58:00 user nova-compute[82184]:         </nova:port>
Apr 12 01:58:00 user nova-compute[82184]:       </nova:ports>
Apr 12 01:58:00 user nova-compute[82184]:     </nova:instance>
Apr 12 01:58:00 user nova-compute[82184]:   </metadata>
Apr 12 01:58:00 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:58:00 user nova-compute[82184]:     <system>
Apr 12 01:58:00 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:58:00 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:58:00 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:58:00 user nova-compute[82184]:       <entry name="serial">0d49cd12-9b4d-4a93-ad5f-bbf0536d5959</entry>
Apr 12 01:58:00 user nova-compute[82184]:       <entry name="uuid">0d49cd12-9b4d-4a93-ad5f-bbf0536d5959</entry>
Apr 12 01:58:00 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:58:00 user nova-compute[82184]:     </system>
Apr 12 01:58:00 user nova-compute[82184]:   </sysinfo>
Apr 12 01:58:00 user nova-compute[82184]:   <os>
Apr 12 01:58:00 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:58:00 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:58:00 user nova-compute[82184]:   </os>
Apr 12 01:58:00 user nova-compute[82184]:   <features>
Apr 12 01:58:00 user nova-compute[82184]:     <acpi/>
Apr 12 01:58:00 user nova-compute[82184]:     <apic/>
Apr 12 01:58:00 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:58:00 user nova-compute[82184]:   </features>
Apr 12 01:58:00 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:58:00 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:58:00 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:58:00 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:58:00 user nova-compute[82184]:   </clock>
Apr 12 01:58:00 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:58:00 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:58:00 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:58:00 user nova-compute[82184]:   </cpu>
Apr 12 01:58:00 user nova-compute[82184]:   <devices>
Apr 12 01:58:00 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:58:00 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:58:00 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk"/>
Apr 12 01:58:00 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:58:00 user nova-compute[82184]:     </disk>
Apr 12 01:58:00 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:58:00 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:58:00 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 01:58:00 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 01:58:00 user nova-compute[82184]:       <serial>cf91b105-163e-4c1d-a936-6939ccb3db3f</serial>
Apr 12 01:58:00 user nova-compute[82184]:     </disk>
Apr 12 01:58:00 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:58:00 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:58:00 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue"/>
Apr 12 01:58:00 user nova-compute[82184]:       <target dev="vdc" bus="virtio"/>
Apr 12 01:58:00 user nova-compute[82184]:       <boot order="1"/>
Apr 12 01:58:00 user nova-compute[82184]:     </disk>
Apr 12 01:58:00 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:58:00 user nova-compute[82184]:       <mac address="fa:16:3e:f4:60:ca"/>
Apr 12 01:58:00 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:58:00 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:58:00 user nova-compute[82184]:       <target dev="tap77c37f41-cb"/>
Apr 12 01:58:00 user nova-compute[82184]:     </interface>
Apr 12 01:58:00 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:58:00 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/console.log" append="off"/>
Apr 12 01:58:00 user nova-compute[82184]:     </serial>
Apr 12 01:58:00 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:58:00 user nova-compute[82184]:     <video>
Apr 12 01:58:00 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:58:00 user nova-compute[82184]:     </video>
Apr 12 01:58:00 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:58:00 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:58:00 user nova-compute[82184]:     </rng>
Apr 12 01:58:00 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:58:00 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:58:00 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:58:00 user nova-compute[82184]:     </memballoon>
Apr 12 01:58:00 user nova-compute[82184]:   </devices>
Apr 12 01:58:00 user nova-compute[82184]: </domain>
Apr 12 01:58:00 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:58:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Instance destroyed successfully.
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] No VIF found with MAC fa:16:3e:f4:60:ca, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:58:00 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Took 1.11 seconds to deallocate network for instance.
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-09514ea4-03e0-4d13-8f0b-33343696c36d req-9e10a123-6cc8-45f9-9758-418136d4de73 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-plugged-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-09514ea4-03e0-4d13-8f0b-33343696c36d req-9e10a123-6cc8-45f9-9758-418136d4de73 service nova] Acquiring lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-09514ea4-03e0-4d13-8f0b-33343696c36d req-9e10a123-6cc8-45f9-9758-418136d4de73 service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-09514ea4-03e0-4d13-8f0b-33343696c36d req-9e10a123-6cc8-45f9-9758-418136d4de73 service nova] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-09514ea4-03e0-4d13-8f0b-33343696c36d req-9e10a123-6cc8-45f9-9758-418136d4de73 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] No waiting events found dispatching network-vif-plugged-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:00 user nova-compute[82184]: WARNING nova.compute.manager [req-09514ea4-03e0-4d13-8f0b-33343696c36d req-9e10a123-6cc8-45f9-9758-418136d4de73 service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received unexpected event network-vif-plugged-0e649e0b-d93b-473c-a765-b0173cea1a6d for instance with vm_state deleted and task_state None.
Apr 12 01:58:01 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:58:01 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:58:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:01 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Deleted allocations for instance 5b7cbacb-f776-4e9a-b333-ce9c345dc525
Apr 12 01:58:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-84f795d1-1f67-4ee4-ad00-96e76a5cc389 tempest-TaggedAttachmentsTest-1804071739 tempest-TaggedAttachmentsTest-1804071739-project-member] Lock "5b7cbacb-f776-4e9a-b333-ce9c345dc525" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.722s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-baef3814-c75a-494a-8a50-77cf45431ef7 req-2342c6a2-73ed-4a5c-b021-0a5e47b6838b service nova] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Received event network-vif-deleted-0e649e0b-d93b-473c-a765-b0173cea1a6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-baef3814-c75a-494a-8a50-77cf45431ef7 req-2342c6a2-73ed-4a5c-b021-0a5e47b6838b service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-baef3814-c75a-494a-8a50-77cf45431ef7 req-2342c6a2-73ed-4a5c-b021-0a5e47b6838b service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-baef3814-c75a-494a-8a50-77cf45431ef7 req-2342c6a2-73ed-4a5c-b021-0a5e47b6838b service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-baef3814-c75a-494a-8a50-77cf45431ef7 req-2342c6a2-73ed-4a5c-b021-0a5e47b6838b service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-baef3814-c75a-494a-8a50-77cf45431ef7 req-2342c6a2-73ed-4a5c-b021-0a5e47b6838b service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:02 user nova-compute[82184]: WARNING nova.compute.manager [req-baef3814-c75a-494a-8a50-77cf45431ef7 req-2342c6a2-73ed-4a5c-b021-0a5e47b6838b service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state active and task_state rescuing.
Apr 12 01:58:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "39c1ed52-fe5b-4e57-854a-36476bdb215c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:03 user nova-compute[82184]: INFO nova.compute.manager [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Terminating instance
Apr 12 01:58:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-e8aa05ad-143c-4f45-a996-39d92587409b req-fc9238ce-f4bc-48b2-8d1c-7b7b3c95ad11 service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Received event network-vif-unplugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e8aa05ad-143c-4f45-a996-39d92587409b req-fc9238ce-f4bc-48b2-8d1c-7b7b3c95ad11 service nova] Acquiring lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e8aa05ad-143c-4f45-a996-39d92587409b req-fc9238ce-f4bc-48b2-8d1c-7b7b3c95ad11 service nova] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e8aa05ad-143c-4f45-a996-39d92587409b req-fc9238ce-f4bc-48b2-8d1c-7b7b3c95ad11 service nova] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-e8aa05ad-143c-4f45-a996-39d92587409b req-fc9238ce-f4bc-48b2-8d1c-7b7b3c95ad11 service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] No waiting events found dispatching network-vif-unplugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-e8aa05ad-143c-4f45-a996-39d92587409b req-fc9238ce-f4bc-48b2-8d1c-7b7b3c95ad11 service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Received event network-vif-unplugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:04 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Instance destroyed successfully.
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lazy-loading 'resources' on Instance uuid 39c1ed52-fe5b-4e57-854a-36476bdb215c {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:56:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1665338189',display_name='tempest-VolumesActionsTest-instance-1665338189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1665338189',id=18,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:56:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce361b6fa374bca8dc0a48a53ad54f9',ramdisk_id='',reservation_id='r-y66qrqwn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-89585441',owner_user_name='tempest-VolumesActionsTest-89585441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:56:19Z,user_data=None,user_id='4d876b30b1724669a8d7e8bd543fa18c',uuid=39c1ed52-fe5b-4e57-854a-36476bdb215c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "address": "fa:16:3e:f1:95:9f", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adf6f7b-2c", "ovs_interfaceid": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converting VIF {"id": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "address": "fa:16:3e:f1:95:9f", "network": {"id": "a0d34b37-6e08-4f2e-a7df-43c3b7d8080f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-165278523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "3ce361b6fa374bca8dc0a48a53ad54f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adf6f7b-2c", "ovs_interfaceid": "4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:95:9f,bridge_name='br-int',has_traffic_filtering=True,id=4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adf6f7b-2c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG os_vif [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:95:9f,bridge_name='br-int',has_traffic_filtering=True,id=4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adf6f7b-2c') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4adf6f7b-2c, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:58:04 user nova-compute[82184]: INFO os_vif [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:95:9f,bridge_name='br-int',has_traffic_filtering=True,id=4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec,network=Network(a0d34b37-6e08-4f2e-a7df-43c3b7d8080f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adf6f7b-2c')
Apr 12 01:58:04 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Deleting instance files /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c_del
Apr 12 01:58:04 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Deletion of /opt/stack/data/nova/instances/39c1ed52-fe5b-4e57-854a-36476bdb215c_del complete
Apr 12 01:58:04 user nova-compute[82184]: INFO nova.compute.manager [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Took 0.77 seconds to destroy the instance on the hypervisor.
Apr 12 01:58:04 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264684.3002698, 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:58:04 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] VM Resumed (Lifecycle Event)
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2e452ff3-e327-4826-a795-9c480ec1286f tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:58:04 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264684.3014033, 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:58:04 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] VM Started (Lifecycle Event)
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.compute.manager [req-8c1ba4cc-09cf-48c8-95e9-fd036f2f64e8 req-2d2f4e86-0b6a-4afa-9fe1-b0180a792e56 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c1ba4cc-09cf-48c8-95e9-fd036f2f64e8 req-2d2f4e86-0b6a-4afa-9fe1-b0180a792e56 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c1ba4cc-09cf-48c8-95e9-fd036f2f64e8 req-2d2f4e86-0b6a-4afa-9fe1-b0180a792e56 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8c1ba4cc-09cf-48c8-95e9-fd036f2f64e8 req-2d2f4e86-0b6a-4afa-9fe1-b0180a792e56 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.compute.manager [req-8c1ba4cc-09cf-48c8-95e9-fd036f2f64e8 req-2d2f4e86-0b6a-4afa-9fe1-b0180a792e56 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:04 user nova-compute[82184]: WARNING nova.compute.manager [req-8c1ba4cc-09cf-48c8-95e9-fd036f2f64e8 req-2d2f4e86-0b6a-4afa-9fe1-b0180a792e56 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state rescued and task_state None.
Apr 12 01:58:04 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:58:04 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Took 0.50 seconds to deallocate network for instance.
Apr 12 01:58:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:05 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:58:05 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:58:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:05 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Deleted allocations for instance 39c1ed52-fe5b-4e57-854a-36476bdb215c
Apr 12 01:58:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e6d3ee6c-7a7f-4acc-bec6-660003aacff2 tempest-VolumesActionsTest-89585441 tempest-VolumesActionsTest-89585441-project-member] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.763s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-1d148b9e-9ca8-4931-a0ec-332f2f4873ec req-91801ab0-5b8f-4e8d-b645-ec11355c8891 service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Received event network-vif-plugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1d148b9e-9ca8-4931-a0ec-332f2f4873ec req-91801ab0-5b8f-4e8d-b645-ec11355c8891 service nova] Acquiring lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1d148b9e-9ca8-4931-a0ec-332f2f4873ec req-91801ab0-5b8f-4e8d-b645-ec11355c8891 service nova] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1d148b9e-9ca8-4931-a0ec-332f2f4873ec req-91801ab0-5b8f-4e8d-b645-ec11355c8891 service nova] Lock "39c1ed52-fe5b-4e57-854a-36476bdb215c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-1d148b9e-9ca8-4931-a0ec-332f2f4873ec req-91801ab0-5b8f-4e8d-b645-ec11355c8891 service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] No waiting events found dispatching network-vif-plugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:05 user nova-compute[82184]: WARNING nova.compute.manager [req-1d148b9e-9ca8-4931-a0ec-332f2f4873ec req-91801ab0-5b8f-4e8d-b645-ec11355c8891 service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Received unexpected event network-vif-plugged-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec for instance with vm_state deleted and task_state None.
Apr 12 01:58:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-73513515-a2e9-460f-a7d4-380164e70ec0 req-8aa546aa-06e7-483b-8f31-734b67c96d26 service nova] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Received event network-vif-deleted-4adf6f7b-2ca4-41b3-b8e4-85a2b15f6dec {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:58:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 01:58:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:58:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 01:58:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:14 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264679.341507, 5b7cbacb-f776-4e9a-b333-ce9c345dc525 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:58:14 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] VM Stopped (Lifecycle Event)
Apr 12 01:58:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6cf63992-8dce-4765-bf21-68d72968e104 None None] [instance: 5b7cbacb-f776-4e9a-b333-ce9c345dc525] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264684.1673653, 39c1ed52-fe5b-4e57-854a-36476bdb215c => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:58:19 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] VM Stopped (Lifecycle Event)
Apr 12 01:58:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0c92c385-6004-47df-9b06-b1f3c0f4636c None None] [instance: 39c1ed52-fe5b-4e57-854a-36476bdb215c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:58:19 user nova-compute[82184]: INFO nova.compute.claims [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Claim successful on node user
Apr 12 01:58:19 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:58:20 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.policy [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '889189da060e4b54a48ce9a013e04a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fed0886b2404f41a659dc6356771e9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:58:20 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Creating image(s)
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk 1073741824" returned: 0 in 0.052s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Cannot resize image /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'migration_context' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Ensure instance console log exists: /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Successfully created port: b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Successfully updated port: b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquired lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-9aa54fb4-96eb-421d-bae8-ba6a4264053e req-ad481e13-0d9e-43e4-b90c-c457c72c0bff service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-changed-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-9aa54fb4-96eb-421d-bae8-ba6a4264053e req-ad481e13-0d9e-43e4-b90c-c457c72c0bff service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Refreshing instance network info cache due to event network-changed-b1709cc0-5e25-4f89-aa42-8bc0a424adc1. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9aa54fb4-96eb-421d-bae8-ba6a4264053e req-ad481e13-0d9e-43e4-b90c-c457c72c0bff service nova] Acquiring lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updating instance_info_cache with network_info: [{"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Releasing lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Instance network_info: |[{"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9aa54fb4-96eb-421d-bae8-ba6a4264053e req-ad481e13-0d9e-43e4-b90c-c457c72c0bff service nova] Acquired lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.network.neutron [req-9aa54fb4-96eb-421d-bae8-ba6a4264053e req-ad481e13-0d9e-43e4-b90c-c457c72c0bff service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Refreshing network info cache for port b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Start _get_guest_xml network_info=[{"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:58:22 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:58:22 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1373752537',display_name='tempest-ServerRescueNegativeTestJSON-server-1373752537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1373752537',id=21,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIbKc6xSzjYSTxxI8C/IAZs7b7MlyezBiUXhjYxXfwthgDrpaDZJYY7wb6RFJBJGBUJGdDeu+0PCYgm+2/EOL1dCVnyqQ1ADD+YRouh7yBs349raBu7ykBoZaVMgsZIuA==',key_name='tempest-keypair-2119544665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-gcc6bego',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:58:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='889189da060e4b54a48ce9a013e04a3d',uuid=84b4902c-24d9-4e96-b51f-e93e913aa681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=b1709cc0-5e25-4f89-aa42-8bc0a424adc1,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1709cc0-5e') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'pci_devices' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:58:22 user nova-compute[82184]:   <uuid>84b4902c-24d9-4e96-b51f-e93e913aa681</uuid>
Apr 12 01:58:22 user nova-compute[82184]:   <name>instance-00000015</name>
Apr 12 01:58:22 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:58:22 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:58:22 user nova-compute[82184]:   <metadata>
Apr 12 01:58:22 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:58:22 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:58:22 user nova-compute[82184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1373752537</nova:name>
Apr 12 01:58:22 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:58:22</nova:creationTime>
Apr 12 01:58:22 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:58:22 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:58:22 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:58:22 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:58:22 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:58:22 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:58:22 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:58:22 user nova-compute[82184]:       <nova:owner>
Apr 12 01:58:22 user nova-compute[82184]:         <nova:user uuid="889189da060e4b54a48ce9a013e04a3d">tempest-ServerRescueNegativeTestJSON-502185932-project-member</nova:user>
Apr 12 01:58:22 user nova-compute[82184]:         <nova:project uuid="8fed0886b2404f41a659dc6356771e9c">tempest-ServerRescueNegativeTestJSON-502185932</nova:project>
Apr 12 01:58:22 user nova-compute[82184]:       </nova:owner>
Apr 12 01:58:22 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:58:22 user nova-compute[82184]:       <nova:ports>
Apr 12 01:58:22 user nova-compute[82184]:         <nova:port uuid="b1709cc0-5e25-4f89-aa42-8bc0a424adc1">
Apr 12 01:58:22 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 01:58:22 user nova-compute[82184]:         </nova:port>
Apr 12 01:58:22 user nova-compute[82184]:       </nova:ports>
Apr 12 01:58:22 user nova-compute[82184]:     </nova:instance>
Apr 12 01:58:22 user nova-compute[82184]:   </metadata>
Apr 12 01:58:22 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:58:22 user nova-compute[82184]:     <system>
Apr 12 01:58:22 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:58:22 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:58:22 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:58:22 user nova-compute[82184]:       <entry name="serial">84b4902c-24d9-4e96-b51f-e93e913aa681</entry>
Apr 12 01:58:22 user nova-compute[82184]:       <entry name="uuid">84b4902c-24d9-4e96-b51f-e93e913aa681</entry>
Apr 12 01:58:22 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:58:22 user nova-compute[82184]:     </system>
Apr 12 01:58:22 user nova-compute[82184]:   </sysinfo>
Apr 12 01:58:22 user nova-compute[82184]:   <os>
Apr 12 01:58:22 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:58:22 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:58:22 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:58:22 user nova-compute[82184]:   </os>
Apr 12 01:58:22 user nova-compute[82184]:   <features>
Apr 12 01:58:22 user nova-compute[82184]:     <acpi/>
Apr 12 01:58:22 user nova-compute[82184]:     <apic/>
Apr 12 01:58:22 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:58:22 user nova-compute[82184]:   </features>
Apr 12 01:58:22 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:58:22 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:58:22 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:58:22 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:58:22 user nova-compute[82184]:   </clock>
Apr 12 01:58:22 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:58:22 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:58:22 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:58:22 user nova-compute[82184]:   </cpu>
Apr 12 01:58:22 user nova-compute[82184]:   <devices>
Apr 12 01:58:22 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:58:22 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:58:22 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk"/>
Apr 12 01:58:22 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:58:22 user nova-compute[82184]:     </disk>
Apr 12 01:58:22 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:58:22 user nova-compute[82184]:       <mac address="fa:16:3e:fd:07:d9"/>
Apr 12 01:58:22 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:58:22 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:58:22 user nova-compute[82184]:       <target dev="tapb1709cc0-5e"/>
Apr 12 01:58:22 user nova-compute[82184]:     </interface>
Apr 12 01:58:22 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:58:22 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/console.log" append="off"/>
Apr 12 01:58:22 user nova-compute[82184]:     </serial>
Apr 12 01:58:22 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:58:22 user nova-compute[82184]:     <video>
Apr 12 01:58:22 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:58:22 user nova-compute[82184]:     </video>
Apr 12 01:58:22 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:58:22 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:58:22 user nova-compute[82184]:     </rng>
Apr 12 01:58:22 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:58:22 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:58:22 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:58:22 user nova-compute[82184]:     </memballoon>
Apr 12 01:58:22 user nova-compute[82184]:   </devices>
Apr 12 01:58:22 user nova-compute[82184]: </domain>
Apr 12 01:58:22 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1373752537',display_name='tempest-ServerRescueNegativeTestJSON-server-1373752537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1373752537',id=21,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIbKc6xSzjYSTxxI8C/IAZs7b7MlyezBiUXhjYxXfwthgDrpaDZJYY7wb6RFJBJGBUJGdDeu+0PCYgm+2/EOL1dCVnyqQ1ADD+YRouh7yBs349raBu7ykBoZaVMgsZIuA==',key_name='tempest-keypair-2119544665',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-gcc6bego',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:58:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='889189da060e4b54a48ce9a013e04a3d',uuid=84b4902c-24d9-4e96-b51f-e93e913aa681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=b1709cc0-5e25-4f89-aa42-8bc0a424adc1,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1709cc0-5e') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG os_vif [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=b1709cc0-5e25-4f89-aa42-8bc0a424adc1,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1709cc0-5e') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1709cc0-5e, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1709cc0-5e, col_values=(('external_ids', {'iface-id': 'b1709cc0-5e25-4f89-aa42-8bc0a424adc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:07:d9', 'vm-uuid': '84b4902c-24d9-4e96-b51f-e93e913aa681'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:22 user nova-compute[82184]: INFO os_vif [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=b1709cc0-5e25-4f89-aa42-8bc0a424adc1,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1709cc0-5e')
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:58:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No VIF found with MAC fa:16:3e:fd:07:d9, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:58:23 user nova-compute[82184]: DEBUG nova.network.neutron [req-9aa54fb4-96eb-421d-bae8-ba6a4264053e req-ad481e13-0d9e-43e4-b90c-c457c72c0bff service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updated VIF entry in instance network info cache for port b1709cc0-5e25-4f89-aa42-8bc0a424adc1. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:58:23 user nova-compute[82184]: DEBUG nova.network.neutron [req-9aa54fb4-96eb-421d-bae8-ba6a4264053e req-ad481e13-0d9e-43e4-b90c-c457c72c0bff service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updating instance_info_cache with network_info: [{"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:58:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9aa54fb4-96eb-421d-bae8-ba6a4264053e req-ad481e13-0d9e-43e4-b90c-c457c72c0bff service nova] Releasing lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:58:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:24 user nova-compute[82184]: DEBUG nova.compute.manager [req-26d24e72-847b-46e6-bb6e-35c97802b257 req-31d68faa-ca05-461f-85c7-82c60337d892 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-26d24e72-847b-46e6-bb6e-35c97802b257 req-31d68faa-ca05-461f-85c7-82c60337d892 service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-26d24e72-847b-46e6-bb6e-35c97802b257 req-31d68faa-ca05-461f-85c7-82c60337d892 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-26d24e72-847b-46e6-bb6e-35c97802b257 req-31d68faa-ca05-461f-85c7-82c60337d892 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:24 user nova-compute[82184]: DEBUG nova.compute.manager [req-26d24e72-847b-46e6-bb6e-35c97802b257 req-31d68faa-ca05-461f-85c7-82c60337d892 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:24 user nova-compute[82184]: WARNING nova.compute.manager [req-26d24e72-847b-46e6-bb6e-35c97802b257 req-31d68faa-ca05-461f-85c7-82c60337d892 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state building and task_state spawning.
Apr 12 01:58:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264706.5452142, 84b4902c-24d9-4e96-b51f-e93e913aa681 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:58:26 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] VM Resumed (Lifecycle Event)
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:58:26 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Instance spawned successfully.
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:58:26 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264706.5490046, 84b4902c-24d9-4e96-b51f-e93e913aa681 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:58:26 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] VM Started (Lifecycle Event)
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:58:26 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.compute.manager [req-15006d1a-a9ae-4ff5-b5b6-5badc6bcda84 req-b28b5147-34ea-4d1a-b418-e854507dc6af service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-15006d1a-a9ae-4ff5-b5b6-5badc6bcda84 req-b28b5147-34ea-4d1a-b418-e854507dc6af service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-15006d1a-a9ae-4ff5-b5b6-5badc6bcda84 req-b28b5147-34ea-4d1a-b418-e854507dc6af service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-15006d1a-a9ae-4ff5-b5b6-5badc6bcda84 req-b28b5147-34ea-4d1a-b418-e854507dc6af service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.compute.manager [req-15006d1a-a9ae-4ff5-b5b6-5badc6bcda84 req-b28b5147-34ea-4d1a-b418-e854507dc6af service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:26 user nova-compute[82184]: WARNING nova.compute.manager [req-15006d1a-a9ae-4ff5-b5b6-5badc6bcda84 req-b28b5147-34ea-4d1a-b418-e854507dc6af service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state building and task_state spawning.
Apr 12 01:58:26 user nova-compute[82184]: INFO nova.compute.manager [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Took 6.48 seconds to spawn the instance on the hypervisor.
Apr 12 01:58:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:26 user nova-compute[82184]: INFO nova.compute.manager [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Took 7.31 seconds to build instance.
Apr 12 01:58:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4377791a-50c3-4bc0-b97f-ddd11601e5cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.402s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG nova.objects.instance [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'flavor' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:27 user nova-compute[82184]: INFO nova.compute.manager [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attaching volume 7c40d13a-f773-494b-be5c-b559dfc5686a to /dev/vdb
Apr 12 01:58:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG os_brick.utils [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[70049099-e155-439b-bd3a-8b8518984169]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e85b9f-8dd1-44dd-9d1f-0460997d55ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f34ad18-bfaf-4ca2-a9e9-faebaeb1c04f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64b8e4b-aa09-4ed7-8a65-d49d8155e9b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:58:27 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:58:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[135ab673-6278-490d-9a31-74dc955931d9]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG os_brick.utils [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:58:27 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating existing volume attachment record: 3ab7d119-89cf-4419-bc4f-eb3a1e8f9961 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:58:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:58:32 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:58:32 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:58:32 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b53b77-a63b-426f-9de9-c4883162545f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:58:32 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96599ad3-1d06-4aa4-b4f0-2bb72c57e36f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a] added
Apr 12 01:58:32 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ab41be-956e-4a51-9e3e-61c5c164031b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5caa6e-fdd8-4c3e-86fd-48f446d82c25]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAGdQMby {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAGdQMby" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24064ae7-ed57-4225-a9dd-d49121479633]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAGdQMby'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91d7b46-590e-4650-80c6-59584a4326a4]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:32 user nova-compute[82184]: INFO nova.compute.manager [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Terminating instance
Apr 12 01:58:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49e28e7-b38e-4110-9262-2294b49a3701]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:32 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:32 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e35dbb-e9c0-4fd4-9f56-d472bb6d5353]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]
Apr 12 01:58:32 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.
Apr 12 01:58:32 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5112d79e-03c8-499b-ac98-2868aba15e4d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a872aa69-1d8d-42d5-bbf5-aebf85940741]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:32 user nova-compute[82184]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:58:32 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:32 user nova-compute[82184]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:58:32 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7f7824-6d36-48da-aac1-bbcf1c0ded35]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-0c7915cd-5944-48f3-8cce-3159b7c0b4fe req-5d812448-3585-4b5f-bdf2-f65f4114e8c5 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Received event network-vif-unplugged-d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0c7915cd-5944-48f3-8cce-3159b7c0b4fe req-5d812448-3585-4b5f-bdf2-f65f4114e8c5 service nova] Acquiring lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0c7915cd-5944-48f3-8cce-3159b7c0b4fe req-5d812448-3585-4b5f-bdf2-f65f4114e8c5 service nova] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0c7915cd-5944-48f3-8cce-3159b7c0b4fe req-5d812448-3585-4b5f-bdf2-f65f4114e8c5 service nova] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-0c7915cd-5944-48f3-8cce-3159b7c0b4fe req-5d812448-3585-4b5f-bdf2-f65f4114e8c5 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] No waiting events found dispatching network-vif-unplugged-d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-0c7915cd-5944-48f3-8cce-3159b7c0b4fe req-5d812448-3585-4b5f-bdf2-f65f4114e8c5 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Received event network-vif-unplugged-d776e917-e4e5-4688-b138-ffb1eebbb61f for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:58:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Instance destroyed successfully.
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lazy-loading 'resources' on Instance uuid dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-49623664',display_name='tempest-ServersNegativeTestJSON-server-49623664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-49623664',id=4,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='021f9aee2b7849ef8fcd67d6d6522d27',ramdisk_id='',reservation_id='r-8nmxa4pu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-292036935',owner_user_name='tempest-ServersNegativeTestJSON-292036935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:50:10Z,user_data=None,user_id='728c534ef1f54c50ad2b619b44c3b9c7',uuid=dfe43143-ac3d-4aed-9a6e-5ec27fb609e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converting VIF {"id": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "address": "fa:16:3e:1b:34:2b", "network": {"id": "1d227a8b-1ad3-4bc6-a32e-4322c8f75eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-316544756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "021f9aee2b7849ef8fcd67d6d6522d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd776e917-e4", "ovs_interfaceid": "d776e917-e4e5-4688-b138-ffb1eebbb61f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:34:2b,bridge_name='br-int',has_traffic_filtering=True,id=d776e917-e4e5-4688-b138-ffb1eebbb61f,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd776e917-e4') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG os_vif [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:34:2b,bridge_name='br-int',has_traffic_filtering=True,id=d776e917-e4e5-4688-b138-ffb1eebbb61f,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd776e917-e4') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd776e917-e4, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:58:33 user nova-compute[82184]: INFO os_vif [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:34:2b,bridge_name='br-int',has_traffic_filtering=True,id=d776e917-e4e5-4688-b138-ffb1eebbb61f,network=Network(1d227a8b-1ad3-4bc6-a32e-4322c8f75eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd776e917-e4')
Apr 12 01:58:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Deleting instance files /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4_del
Apr 12 01:58:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Deletion of /opt/stack/data/nova/instances/dfe43143-ac3d-4aed-9a6e-5ec27fb609e4_del complete
Apr 12 01:58:33 user nova-compute[82184]: INFO nova.compute.manager [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 01:58:33 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23136393463663966', 'path': '/dev/sdc'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136393463663966', 'path': '/dev/sdc'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'flavor' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:58:33 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:58:33 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 01:58:33 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:58:33 user nova-compute[82184]:   <serial>7c40d13a-f773-494b-be5c-b559dfc5686a</serial>
Apr 12 01:58:33 user nova-compute[82184]: </disk>
Apr 12 01:58:33 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:58:33 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Took 0.51 seconds to deallocate network for instance.
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-04a78901-6e81-4fdc-8233-91a277cf6a29 req-0353dd67-2807-40df-8ed3-ccc100eb0b74 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Received event network-vif-deleted-d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:33 user nova-compute[82184]: INFO nova.compute.manager [req-04a78901-6e81-4fdc-8233-91a277cf6a29 req-0353dd67-2807-40df-8ed3-ccc100eb0b74 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Neutron deleted interface d776e917-e4e5-4688-b138-ffb1eebbb61f; detaching it from the instance and deleting it from the info cache
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.network.neutron [req-04a78901-6e81-4fdc-8233-91a277cf6a29 req-0353dd67-2807-40df-8ed3-ccc100eb0b74 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-04a78901-6e81-4fdc-8233-91a277cf6a29 req-0353dd67-2807-40df-8ed3-ccc100eb0b74 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Detach interface failed, port_id=d776e917-e4e5-4688-b138-ffb1eebbb61f, reason: Instance dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No VIF found with MAC fa:16:3e:f9:ed:df, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:34 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Deleted allocations for instance dfe43143-ac3d-4aed-9a6e-5ec27fb609e4
Apr 12 01:58:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-87726f8b-1462-4b19-9049-97bc06199ad4 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.501s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2de62f61-c072-4c68-bb64-67c9fc16afc5 tempest-ServersNegativeTestJSON-292036935 tempest-ServersNegativeTestJSON-292036935-project-member] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.917s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-29a53d0f-195b-4a46-8cbf-a4bc5d8cb06e req-a92b7513-bcc1-4fb5-bc28-0dd896650497 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Received event network-vif-plugged-d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-29a53d0f-195b-4a46-8cbf-a4bc5d8cb06e req-a92b7513-bcc1-4fb5-bc28-0dd896650497 service nova] Acquiring lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-29a53d0f-195b-4a46-8cbf-a4bc5d8cb06e req-a92b7513-bcc1-4fb5-bc28-0dd896650497 service nova] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-29a53d0f-195b-4a46-8cbf-a4bc5d8cb06e req-a92b7513-bcc1-4fb5-bc28-0dd896650497 service nova] Lock "dfe43143-ac3d-4aed-9a6e-5ec27fb609e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-29a53d0f-195b-4a46-8cbf-a4bc5d8cb06e req-a92b7513-bcc1-4fb5-bc28-0dd896650497 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] No waiting events found dispatching network-vif-plugged-d776e917-e4e5-4688-b138-ffb1eebbb61f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:34 user nova-compute[82184]: WARNING nova.compute.manager [req-29a53d0f-195b-4a46-8cbf-a4bc5d8cb06e req-a92b7513-bcc1-4fb5-bc28-0dd896650497 service nova] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Received unexpected event network-vif-plugged-d776e917-e4e5-4688-b138-ffb1eebbb61f for instance with vm_state deleted and task_state None.
Apr 12 01:58:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Stashing vm_state: active {{(pid=82184) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 01:58:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'pci_requests' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:58:36 user nova-compute[82184]: INFO nova.compute.claims [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Claim successful on node user
Apr 12 01:58:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'resources' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'pci_devices' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:36 user nova-compute[82184]: INFO nova.compute.resource_tracker [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating resource usage from migration 7687ad16-d1d8-435d-8780-facafbde3a7a
Apr 12 01:58:37 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:58:37 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:58:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.532s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:37 user nova-compute[82184]: INFO nova.compute.manager [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Migrating
Apr 12 01:58:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:58:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "compute-rpcapi-router" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:58:37 user nova-compute[82184]: INFO nova.compute.rpcapi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 12 01:58:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "compute-rpcapi-router" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:58:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:58:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:58:37 user nova-compute[82184]: DEBUG nova.network.neutron [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:58:37 user nova-compute[82184]: DEBUG nova.network.neutron [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:58:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:58:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Starting migrate_disk_and_power_off {{(pid=82184) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-8ea30855-67d6-47c3-aa42-94354d5b0d02 req-eca5cb63-68ea-4b59-bf79-09ca9551668a service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8ea30855-67d6-47c3-aa42-94354d5b0d02 req-eca5cb63-68ea-4b59-bf79-09ca9551668a service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8ea30855-67d6-47c3-aa42-94354d5b0d02 req-eca5cb63-68ea-4b59-bf79-09ca9551668a service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8ea30855-67d6-47c3-aa42-94354d5b0d02 req-eca5cb63-68ea-4b59-bf79-09ca9551668a service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-8ea30855-67d6-47c3-aa42-94354d5b0d02 req-eca5cb63-68ea-4b59-bf79-09ca9551668a service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:38 user nova-compute[82184]: WARNING nova.compute.manager [req-8ea30855-67d6-47c3-aa42-94354d5b0d02 req-eca5cb63-68ea-4b59-bf79-09ca9551668a service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state active and task_state resize_migrating.
Apr 12 01:58:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:38 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance destroyed successfully.
Apr 12 01:58:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-1476053452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:58:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:f9:ed:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:f9:ed:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_vif [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap365b7a91-79, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:38 user nova-compute[82184]: INFO os_vif [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79')
Apr 12 01:58:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:58:38 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae183b45-10dd-4fba-9d9b-e42c385f05fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:58:38 user nova-compute[82184]: No targets found.
Apr 12 01:58:38 user nova-compute[82184]: iSNS:
Apr 12 01:58:38 user nova-compute[82184]: No targets found.
Apr 12 01:58:38 user nova-compute[82184]: STATIC:
Apr 12 01:58:38 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 01:58:38 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:58:38 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:58:38 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f
Apr 12 01:58:38 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:58:38 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:58:38 user nova-compute[82184]: FIRMWARE:
Apr 12 01:58:38 user nova-compute[82184]: No targets found.
Apr 12 01:58:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:58:38 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:58:38 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be96aba3-d85d-47f1-a73c-6e61514eb870]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca58ac9-2c27-452e-adac-082368eecda5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:38 user nova-compute[82184]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:58:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:38 user nova-compute[82184]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:58:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a80ebf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a'): ({'sdc'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Removing single pathed devices sdc {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcddc306-bbd4-4e0a-b803-f1a3c165d731]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87280248-7e14-4b0e-b96e-d24b93deda68]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flushing IO for device /dev/sdc {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80fed0-6ff8-465b-91db-542f3fc8e30e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42739e1-93f7-482c-97c0-f93d78842e2e]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbf172c-0ed7-4abf-9ee1-2d2d28737e9a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe90ad-3ed8-44fe-969a-bd2bb2b0ac67]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]
Apr 12 01:58:39 user nova-compute[82184]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.
Apr 12 01:58:39 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79bf550-1553-41b1-9168-825aebeb89d1]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== disconnect_volume: return (296ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6_resize/disk /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "cp -r /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6_resize/disk /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk" returned: 0 in 0.260s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6_resize/disk.info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk.info {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "cp -r /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6_resize/disk.info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk.info" returned: 0 in 0.031s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-bd2612ef-a3fc-4abe-972d-a228dad6fbd5 req-3fe5241d-6b6f-4ce3-b922-dcf53c3bad83 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bd2612ef-a3fc-4abe-972d-a228dad6fbd5 req-3fe5241d-6b6f-4ce3-b922-dcf53c3bad83 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bd2612ef-a3fc-4abe-972d-a228dad6fbd5 req-3fe5241d-6b6f-4ce3-b922-dcf53c3bad83 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bd2612ef-a3fc-4abe-972d-a228dad6fbd5 req-3fe5241d-6b6f-4ce3-b922-dcf53c3bad83 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-bd2612ef-a3fc-4abe-972d-a228dad6fbd5 req-3fe5241d-6b6f-4ce3-b922-dcf53c3bad83 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:40 user nova-compute[82184]: WARNING nova.compute.manager [req-bd2612ef-a3fc-4abe-972d-a228dad6fbd5 req-3fe5241d-6b6f-4ce3-b922-dcf53c3bad83 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state active and task_state resize_migrating.
Apr 12 01:58:40 user nova-compute[82184]: DEBUG nova.network.neutron [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Port 365b7a91-793f-4aaf-af62-4e1c45d300e8 binding to destination host user is already ACTIVE {{(pid=82184) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:58:40 user nova-compute[82184]: DEBUG nova.network.neutron [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG nova.network.neutron [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG os_brick.utils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[db457eed-e10f-4e43-a772-a1d09e584a57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46ed3c8-176e-401c-b12e-6b14f053f933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f929cd7-51e3-4289-8f06-1597153b02b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf35fc6-402f-4d54-8188-c3ef3fcf5c22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:58:41 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:58:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b257dbf-e635-427e-8760-dcc0174a6fa4]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:58:41 user nova-compute[82184]: DEBUG os_brick.utils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:58:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Starting finish_migration {{(pid=82184) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance directory exists: not creating {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 01:58:45 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Creating image(s)
Apr 12 01:58:45 user nova-compute[82184]: DEBUG nova.objects.instance [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'trusted_certs' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:58:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Cannot resize image /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Ensure instance console log exists: /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Start _get_guest_xml network_info=[{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:f9:ed:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': '5f8d1b28-54c2-4a1f-98ef-6c36ff6fc39b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c712f2db-72cb-4136-a719-56057d82fff6', 'attached_at': '2023-04-12T01:58:46.000000', 'detached_at': '', 'volume_id': '7c40d13a-f773-494b-be5c-b559dfc5686a', 'serial': '7c40d13a-f773-494b-be5c-b559dfc5686a'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:58:46 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.objects.instance [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'vcpu_model' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:58:46 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:58:46 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:58:46 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cb3c54-3669-411b-8a7f-dc902f234f56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:58:46 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6892bc-d864-4a55-9c1a-14a3d9cdeedc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a] added
Apr 12 01:58:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[463f89e1-c196-40b5-b1a0-d2c2c5b51e28]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a594e9f0-4947-4abb-9780-e95328dba1f5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAGdQMby {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAGdQMby" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b4649d-fa03-458d-b647-37a69955e4a5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAGdQMby'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3c1faa-b85f-46f9-a011-5cd0a2263c38]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d614e95-75c3-4dc9-b9ea-c4d0f995ef6d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0b506a-6612-4ac7-a3dc-4698defdda32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]
Apr 12 01:58:46 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.
Apr 12 01:58:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e1038f-1c3e-4db3-9d5a-71a7379ac754]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[859cb569-73a6-49f1-8b69-54d1cd0fc130]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:46 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:58:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:58:46 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:58:46 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64c777c-8ff1-44b6-aaea-207310fb155d]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23136393463663966', 'path': '/dev/sdc'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136393463663966', 'path': '/dev/sdc'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-1476053452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:f9:ed:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:f9:ed:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:58:47 user nova-compute[82184]:   <uuid>c712f2db-72cb-4136-a719-56057d82fff6</uuid>
Apr 12 01:58:47 user nova-compute[82184]:   <name>instance-00000002</name>
Apr 12 01:58:47 user nova-compute[82184]:   <memory>196608</memory>
Apr 12 01:58:47 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:58:47 user nova-compute[82184]:   <metadata>
Apr 12 01:58:47 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:58:47 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:58:47 user nova-compute[82184]:       <nova:name>tempest-ServerActionsTestJSON-server-1476053452</nova:name>
Apr 12 01:58:47 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:58:46</nova:creationTime>
Apr 12 01:58:47 user nova-compute[82184]:       <nova:flavor name="m1.micro">
Apr 12 01:58:47 user nova-compute[82184]:         <nova:memory>192</nova:memory>
Apr 12 01:58:47 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:58:47 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:58:47 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:58:47 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:58:47 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:58:47 user nova-compute[82184]:       <nova:owner>
Apr 12 01:58:47 user nova-compute[82184]:         <nova:user uuid="e8e8b9f0307b4d3fb54d89962798026b">tempest-ServerActionsTestJSON-1409832124-project-member</nova:user>
Apr 12 01:58:47 user nova-compute[82184]:         <nova:project uuid="117589cba4a54dd581f4ec5c26b4cd2a">tempest-ServerActionsTestJSON-1409832124</nova:project>
Apr 12 01:58:47 user nova-compute[82184]:       </nova:owner>
Apr 12 01:58:47 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:58:47 user nova-compute[82184]:       <nova:ports>
Apr 12 01:58:47 user nova-compute[82184]:         <nova:port uuid="365b7a91-793f-4aaf-af62-4e1c45d300e8">
Apr 12 01:58:47 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 01:58:47 user nova-compute[82184]:         </nova:port>
Apr 12 01:58:47 user nova-compute[82184]:       </nova:ports>
Apr 12 01:58:47 user nova-compute[82184]:     </nova:instance>
Apr 12 01:58:47 user nova-compute[82184]:   </metadata>
Apr 12 01:58:47 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:58:47 user nova-compute[82184]:     <system>
Apr 12 01:58:47 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:58:47 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:58:47 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:58:47 user nova-compute[82184]:       <entry name="serial">c712f2db-72cb-4136-a719-56057d82fff6</entry>
Apr 12 01:58:47 user nova-compute[82184]:       <entry name="uuid">c712f2db-72cb-4136-a719-56057d82fff6</entry>
Apr 12 01:58:47 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:58:47 user nova-compute[82184]:     </system>
Apr 12 01:58:47 user nova-compute[82184]:   </sysinfo>
Apr 12 01:58:47 user nova-compute[82184]:   <os>
Apr 12 01:58:47 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:58:47 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:58:47 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:58:47 user nova-compute[82184]:   </os>
Apr 12 01:58:47 user nova-compute[82184]:   <features>
Apr 12 01:58:47 user nova-compute[82184]:     <acpi/>
Apr 12 01:58:47 user nova-compute[82184]:     <apic/>
Apr 12 01:58:47 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:58:47 user nova-compute[82184]:   </features>
Apr 12 01:58:47 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:58:47 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:58:47 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:58:47 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:58:47 user nova-compute[82184]:   </clock>
Apr 12 01:58:47 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:58:47 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:58:47 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:58:47 user nova-compute[82184]:   </cpu>
Apr 12 01:58:47 user nova-compute[82184]:   <devices>
Apr 12 01:58:47 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:58:47 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:58:47 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk"/>
Apr 12 01:58:47 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:58:47 user nova-compute[82184]:     </disk>
Apr 12 01:58:47 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:58:47 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:58:47 user nova-compute[82184]:       <source dev="/dev/sdc"/>
Apr 12 01:58:47 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 01:58:47 user nova-compute[82184]:       <serial>7c40d13a-f773-494b-be5c-b559dfc5686a</serial>
Apr 12 01:58:47 user nova-compute[82184]:     </disk>
Apr 12 01:58:47 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:58:47 user nova-compute[82184]:       <mac address="fa:16:3e:f9:ed:df"/>
Apr 12 01:58:47 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:58:47 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:58:47 user nova-compute[82184]:       <target dev="tap365b7a91-79"/>
Apr 12 01:58:47 user nova-compute[82184]:     </interface>
Apr 12 01:58:47 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:58:47 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/console.log" append="off"/>
Apr 12 01:58:47 user nova-compute[82184]:     </serial>
Apr 12 01:58:47 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:58:47 user nova-compute[82184]:     <video>
Apr 12 01:58:47 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:58:47 user nova-compute[82184]:     </video>
Apr 12 01:58:47 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:58:47 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:58:47 user nova-compute[82184]:     </rng>
Apr 12 01:58:47 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:58:47 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:58:47 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:58:47 user nova-compute[82184]:     </memballoon>
Apr 12 01:58:47 user nova-compute[82184]:   </devices>
Apr 12 01:58:47 user nova-compute[82184]: </domain>
Apr 12 01:58:47 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-1476053452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:58:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:f9:ed:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:f9:ed:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG os_vif [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap365b7a91-79, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap365b7a91-79, col_values=(('external_ids', {'iface-id': '365b7a91-793f-4aaf-af62-4e1c45d300e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ed:df', 'vm-uuid': 'c712f2db-72cb-4136-a719-56057d82fff6'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:47 user nova-compute[82184]: INFO os_vif [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79')
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No VIF found with MAC fa:16:3e:f9:ed:df, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264713.1573544, dfe43143-ac3d-4aed-9a6e-5ec27fb609e4 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:58:48 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] VM Stopped (Lifecycle Event)
Apr 12 01:58:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-35973e57-fdd2-4f36-a2aa-55ded59f2f31 None None] [instance: dfe43143-ac3d-4aed-9a6e-5ec27fb609e4] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Acquiring lock "3827c534-7f4a-4f22-bf88-91e8897c6285" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Acquiring lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:48 user nova-compute[82184]: INFO nova.compute.manager [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Terminating instance
Apr 12 01:58:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-b613408e-7aff-4aa4-aca7-0e9d5f39f2c3 req-054a30bf-8596-402e-884b-050afba90f9b service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Received event network-vif-unplugged-b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b613408e-7aff-4aa4-aca7-0e9d5f39f2c3 req-054a30bf-8596-402e-884b-050afba90f9b service nova] Acquiring lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b613408e-7aff-4aa4-aca7-0e9d5f39f2c3 req-054a30bf-8596-402e-884b-050afba90f9b service nova] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b613408e-7aff-4aa4-aca7-0e9d5f39f2c3 req-054a30bf-8596-402e-884b-050afba90f9b service nova] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-b613408e-7aff-4aa4-aca7-0e9d5f39f2c3 req-054a30bf-8596-402e-884b-050afba90f9b service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] No waiting events found dispatching network-vif-unplugged-b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-b613408e-7aff-4aa4-aca7-0e9d5f39f2c3 req-054a30bf-8596-402e-884b-050afba90f9b service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Received event network-vif-unplugged-b0d250e6-f783-4891-aeed-e2204b3b2662 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:58:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for c712f2db-72cb-4136-a719-56057d82fff6 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264731.6706498, c712f2db-72cb-4136-a719-56057d82fff6 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:58:51 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] VM Resumed (Lifecycle Event)
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-bc563623-8ed3-4aa6-a289-963c971b191f req-f89fa241-9194-47a6-b64b-237523aede56 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bc563623-8ed3-4aa6-a289-963c971b191f req-f89fa241-9194-47a6-b64b-237523aede56 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bc563623-8ed3-4aa6-a289-963c971b191f req-f89fa241-9194-47a6-b64b-237523aede56 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bc563623-8ed3-4aa6-a289-963c971b191f req-f89fa241-9194-47a6-b64b-237523aede56 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-bc563623-8ed3-4aa6-a289-963c971b191f req-f89fa241-9194-47a6-b64b-237523aede56 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:51 user nova-compute[82184]: WARNING nova.compute.manager [req-bc563623-8ed3-4aa6-a289-963c971b191f req-f89fa241-9194-47a6-b64b-237523aede56 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state active and task_state resize_finish.
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-774c41ed-93fa-41a6-8d9e-4d143ad2d05e req-21bcc9df-2b3a-43cc-92ab-8679be326f69 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Received event network-vif-plugged-b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-774c41ed-93fa-41a6-8d9e-4d143ad2d05e req-21bcc9df-2b3a-43cc-92ab-8679be326f69 service nova] Acquiring lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-774c41ed-93fa-41a6-8d9e-4d143ad2d05e req-21bcc9df-2b3a-43cc-92ab-8679be326f69 service nova] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-774c41ed-93fa-41a6-8d9e-4d143ad2d05e req-21bcc9df-2b3a-43cc-92ab-8679be326f69 service nova] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-774c41ed-93fa-41a6-8d9e-4d143ad2d05e req-21bcc9df-2b3a-43cc-92ab-8679be326f69 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] No waiting events found dispatching network-vif-plugged-b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:51 user nova-compute[82184]: WARNING nova.compute.manager [req-774c41ed-93fa-41a6-8d9e-4d143ad2d05e req-21bcc9df-2b3a-43cc-92ab-8679be326f69 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Received unexpected event network-vif-plugged-b0d250e6-f783-4891-aeed-e2204b3b2662 for instance with vm_state active and task_state deleting.
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-d9b13786-b4c1-454b-b13b-890f1c7bc655 req-31ac9037-9dcd-40c3-8bbe-68f28f165476 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d9b13786-b4c1-454b-b13b-890f1c7bc655 req-31ac9037-9dcd-40c3-8bbe-68f28f165476 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d9b13786-b4c1-454b-b13b-890f1c7bc655 req-31ac9037-9dcd-40c3-8bbe-68f28f165476 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d9b13786-b4c1-454b-b13b-890f1c7bc655 req-31ac9037-9dcd-40c3-8bbe-68f28f165476 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-d9b13786-b4c1-454b-b13b-890f1c7bc655 req-31ac9037-9dcd-40c3-8bbe-68f28f165476 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:58:51 user nova-compute[82184]: WARNING nova.compute.manager [req-d9b13786-b4c1-454b-b13b-890f1c7bc655 req-31ac9037-9dcd-40c3-8bbe-68f28f165476 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state active and task_state resize_finish.
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Instance destroyed successfully.
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lazy-loading 'resources' on Instance uuid 3827c534-7f4a-4f22-bf88-91e8897c6285 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:58:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance running successfully.
Apr 12 01:58:51 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:58:51 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=7834MB free_disk=26.375789642333984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1646401490',display_name='tempest-VolumesNegativeTest-instance-1646401490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1646401490',id=19,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:57:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd34c505d1bc40a394bfbd2ae2edd9fb',ramdisk_id='',reservation_id='r-yr8oy6wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-523576533',owner_user_name='tempest-VolumesNegativeTest-523576533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:57:06Z,user_data=None,user_id='ac9601d0624f4a19863473f6b14f2bf3',uuid=3827c534-7f4a-4f22-bf88-91e8897c6285,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0d250e6-f783-4891-aeed-e2204b3b2662", "address": "fa:16:3e:fb:74:f9", "network": {"id": "a530c6b7-d1f7-4659-8695-01e8168ae405", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f64ce7ca5af542c6bac7486e15930969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d250e6-f7", "ovs_interfaceid": "b0d250e6-f783-4891-aeed-e2204b3b2662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Converting VIF {"id": "b0d250e6-f783-4891-aeed-e2204b3b2662", "address": "fa:16:3e:fb:74:f9", "network": {"id": "a530c6b7-d1f7-4659-8695-01e8168ae405", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f64ce7ca5af542c6bac7486e15930969", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0d250e6-f7", "ovs_interfaceid": "b0d250e6-f783-4891-aeed-e2204b3b2662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:74:f9,bridge_name='br-int',has_traffic_filtering=True,id=b0d250e6-f783-4891-aeed-e2204b3b2662,network=Network(a530c6b7-d1f7-4659-8695-01e8168ae405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d250e6-f7') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG os_vif [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:74:f9,bridge_name='br-int',has_traffic_filtering=True,id=b0d250e6-f783-4891-aeed-e2204b3b2662,network=Network(a530c6b7-d1f7-4659-8695-01e8168ae405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d250e6-f7') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0d250e6-f7, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Failed to set time: agent not configured {{(pid=82184) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-09800ba9-a41b-439c-b27b-c97441ffb1dc tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] finish_migration finished successfully. {{(pid=82184) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:58:51 user nova-compute[82184]: INFO os_vif [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:74:f9,bridge_name='br-int',has_traffic_filtering=True,id=b0d250e6-f783-4891-aeed-e2204b3b2662,network=Network(a530c6b7-d1f7-4659-8695-01e8168ae405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0d250e6-f7')
Apr 12 01:58:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Deleting instance files /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285_del
Apr 12 01:58:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Deletion of /opt/stack/data/nova/instances/3827c534-7f4a-4f22-bf88-91e8897c6285_del complete
Apr 12 01:58:52 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264731.6717837, c712f2db-72cb-4136-a719-56057d82fff6 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:58:52 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] VM Started (Lifecycle Event)
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:58:52 user nova-compute[82184]: INFO nova.compute.manager [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Took 3.58 seconds to destroy the instance on the hypervisor.
Apr 12 01:58:52 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Applying migration context for instance c712f2db-72cb-4136-a719-56057d82fff6 as it has an incoming, in-progress migration 7687ad16-d1d8-435d-8780-facafbde3a7a. Migration status is finished {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 01:58:52 user nova-compute[82184]: INFO nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating resource usage from migration 7687ad16-d1d8-435d-8780-facafbde3a7a
Apr 12 01:58:52 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cb89325c-680a-4413-8e94-4eddfaa79c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3827c534-7f4a-4f22-bf88-91e8897c6285 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 77f15843-a3a9-4943-a763-0901cd84d7ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 84b4902c-24d9-4e96-b51f-e93e913aa681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Migration 7687ad16-d1d8-435d-8780-facafbde3a7a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:58:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:58:53 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Took 1.12 seconds to deallocate network for instance.
Apr 12 01:58:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-95a004a8-2e11-42b6-a361-fc38cd1ccd27 req-65ef84ae-7099-4fa6-8d5d-35d69c7b1499 service nova] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Received event network-vif-deleted-b0d250e6-f783-4891-aeed-e2204b3b2662 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:58:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:53 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Deleted allocations for instance 3827c534-7f4a-4f22-bf88-91e8897c6285
Apr 12 01:58:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7b076fa0-9f1a-4c8d-9fc2-8c05985c431e tempest-VolumesNegativeTest-523576533 tempest-VolumesNegativeTest-523576533-project-member] Lock "3827c534-7f4a-4f22-bf88-91e8897c6285" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.327s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:58:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:58:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:58:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:58:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:58:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:58:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:58:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:58:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:58:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:58:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:58:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:58:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:06 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264729.4314027, 3827c534-7f4a-4f22-bf88-91e8897c6285 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:59:06 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] VM Stopped (Lifecycle Event)
Apr 12 01:59:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c8d77a36-f78a-490c-bc6d-2e7d252d7da5 None None] [instance: 3827c534-7f4a-4f22-bf88-91e8897c6285] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "77f15843-a3a9-4943-a763-0901cd84d7ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:10 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'flavor' on Instance uuid 77f15843-a3a9-4943-a763-0901cd84d7ca {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:59:10 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Ignoring supplied device name: /dev/vdb
Apr 12 01:59:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "77f15843-a3a9-4943-a763-0901cd84d7ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:11 user nova-compute[82184]: INFO nova.compute.manager [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Attaching volume 16ef6179-f08e-48ff-80c4-d5301b48eecf to /dev/vdb
Apr 12 01:59:11 user nova-compute[82184]: DEBUG os_brick.utils [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4d5e9c-c94a-4c02-a33f-972041442e63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a10e64a-45e0-4c1d-bed1-c089d2c3d875]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3febeaf7-3c45-4468-b65e-cd5b34a948e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a1e0d3-b644-4b69-ac32-0b03fe962b3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:59:11 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:59:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8ff62f-cd48-41f1-8bd8-6f9d3190b79c]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG os_brick.utils [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Updating existing volume attachment record: e334de42-65d8-4009-8920-9a8e2536bc05 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:59:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VErqUzSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:59:16 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:59:16 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:59:16 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260" returned: 21 in 0.045s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[004b801d-313c-40ca-bc69-a7adf82fd610]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:59:16 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8577ecf-3ae0-4a84-aea7-b6abd504cf0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf] added
Apr 12 01:59:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1199ee-f0b4-43cc-a68d-80ea7f1dd603]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c234eb4-ff3f-4ce6-9b30-2909a1b94c73]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VErqUzSn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VErqUzSn" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f17b21f-9f6f-475c-9e2e-8e1e0d3b5071]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VErqUzSn'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e26c5b5-49a0-43b6-aadf-03bae8434f41]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dafaccb-4a44-44ad-9d1d-872d908d744a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c585f69-17ac-4ac2-bb8a-e031712a35e0 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:16 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:16 user nova-compute[82184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c585f69-17ac-4ac2-bb8a-e031712a35e0 (non-flash)
Apr 12 01:59:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:16 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:16 user nova-compute[82184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c585f69-17ac-4ac2-bb8a-e031712a35e0 (non-flash)
Apr 12 01:59:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e125210f-3b99-4931-8220-23b5141dc90c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf, portal: 172.16.0.220,3260]
Apr 12 01:59:16 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf, portal: 172.16.0.220,3260] successful.
Apr 12 01:59:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23c7440-9996-4298-b20d-d30513ad2cfd]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6950f6-03a4-4bfa-9551-997518ffcf9d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c585f69-17ac-4ac2-bb8a-e031712a35e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:16 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:16 user nova-compute[82184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c585f69-17ac-4ac2-bb8a-e031712a35e0 (non-flash)
Apr 12 01:59:16 user nova-compute[82184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf (non-flash)
Apr 12 01:59:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:16 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:16 user nova-compute[82184]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c585f69-17ac-4ac2-bb8a-e031712a35e0 (non-flash)
Apr 12 01:59:16 user nova-compute[82184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf (non-flash)
Apr 12 01:59:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.057s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a49f8da-f15d-42c5-8d97-22e5b3fd13f1]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VErqUzSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:59:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:59:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:59:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23338316138373461', 'path': '/dev/sde'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:59:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338316138373461', 'path': '/dev/sde'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:59:17 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'flavor' on Instance uuid 77f15843-a3a9-4943-a763-0901cd84d7ca {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:59:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 01:59:17 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:59:17 user nova-compute[82184]:   <source dev="/dev/sde"/>
Apr 12 01:59:17 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:59:17 user nova-compute[82184]:   <serial>16ef6179-f08e-48ff-80c4-d5301b48eecf</serial>
Apr 12 01:59:17 user nova-compute[82184]: </disk>
Apr 12 01:59:17 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 01:59:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:59:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:59:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] No VIF found with MAC fa:16:3e:f6:ce:52, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:59:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4069ba3b-cdb2-480e-8567-4d592f4d7520 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.482s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:24 user nova-compute[82184]: INFO nova.compute.manager [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Terminating instance
Apr 12 01:59:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:59:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-ab49d243-abf0-415f-b7c2-a7e312555e0b req-507128fa-af50-40e3-a037-13061d529a3f service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-unplugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ab49d243-abf0-415f-b7c2-a7e312555e0b req-507128fa-af50-40e3-a037-13061d529a3f service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ab49d243-abf0-415f-b7c2-a7e312555e0b req-507128fa-af50-40e3-a037-13061d529a3f service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ab49d243-abf0-415f-b7c2-a7e312555e0b req-507128fa-af50-40e3-a037-13061d529a3f service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-ab49d243-abf0-415f-b7c2-a7e312555e0b req-507128fa-af50-40e3-a037-13061d529a3f service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-unplugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-ab49d243-abf0-415f-b7c2-a7e312555e0b req-507128fa-af50-40e3-a037-13061d529a3f service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-unplugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:59:25 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Instance destroyed successfully.
Apr 12 01:59:25 user nova-compute[82184]: DEBUG nova.objects.instance [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'resources' on Instance uuid cb89325c-680a-4413-8e94-4eddfaa79c6b {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-682748151',display_name='tempest-AttachVolumeTestJSON-server-682748151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-682748151',id=6,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr2NTbVfrYVAmPq/WSiXNxhw73D4U473knUSj3S2SzGG67zJUMcYD7NdTMJnRymKmrJWRxrjStG5itGjTKaX5Cd+wZw4hLfWVikFnVEIrbrRCuVHjjCnBxwGGHScYXLHw==',key_name='tempest-keypair-663896141',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-n3kypybc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=cb89325c-680a-4413-8e94-4eddfaa79c6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "address": "fa:16:3e:9d:cb:06", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec368fc5-6d", "ovs_interfaceid": "ec368fc5-6d05-4bab-8460-cf9f1e024195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG os_vif [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec368fc5-6d, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:59:25 user nova-compute[82184]: INFO os_vif [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:06,bridge_name='br-int',has_traffic_filtering=True,id=ec368fc5-6d05-4bab-8460-cf9f1e024195,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec368fc5-6d')
Apr 12 01:59:25 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Deleting instance files /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b_del
Apr 12 01:59:25 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Deletion of /opt/stack/data/nova/instances/cb89325c-680a-4413-8e94-4eddfaa79c6b_del complete
Apr 12 01:59:25 user nova-compute[82184]: INFO nova.compute.manager [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 12 01:59:25 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:59:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:26 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:59:26 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Took 0.74 seconds to deallocate network for instance.
Apr 12 01:59:26 user nova-compute[82184]: DEBUG nova.compute.manager [req-3ea52263-212d-4ae0-9c9a-893eae76a339 req-4347e827-caa9-4387-896f-5adfc3c4c7cb service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-deleted-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:26 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:59:26 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:59:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:26 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Deleted allocations for instance cb89325c-680a-4413-8e94-4eddfaa79c6b
Apr 12 01:59:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-932b4a81-21eb-4d0d-aef7-0eaf38e5e8d4 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.356s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-233e2365-1f18-4794-8e0e-eb4b9c01481f req-fdc01536-cfec-4990-81e6-43914070d552 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-233e2365-1f18-4794-8e0e-eb4b9c01481f req-fdc01536-cfec-4990-81e6-43914070d552 service nova] Acquiring lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-233e2365-1f18-4794-8e0e-eb4b9c01481f req-fdc01536-cfec-4990-81e6-43914070d552 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-233e2365-1f18-4794-8e0e-eb4b9c01481f req-fdc01536-cfec-4990-81e6-43914070d552 service nova] Lock "cb89325c-680a-4413-8e94-4eddfaa79c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-233e2365-1f18-4794-8e0e-eb4b9c01481f req-fdc01536-cfec-4990-81e6-43914070d552 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] No waiting events found dispatching network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:27 user nova-compute[82184]: WARNING nova.compute.manager [req-233e2365-1f18-4794-8e0e-eb4b9c01481f req-fdc01536-cfec-4990-81e6-43914070d552 service nova] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Received unexpected event network-vif-plugged-ec368fc5-6d05-4bab-8460-cf9f1e024195 for instance with vm_state deleted and task_state None.
Apr 12 01:59:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "77f15843-a3a9-4943-a763-0901cd84d7ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:29 user nova-compute[82184]: INFO nova.compute.manager [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Detaching volume 16ef6179-f08e-48ff-80c4-d5301b48eecf
Apr 12 01:59:29 user nova-compute[82184]: INFO nova.virt.block_device [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Attempting to driver detach volume 16ef6179-f08e-48ff-80c4-d5301b48eecf from mountpoint /dev/vdb
Apr 12 01:59:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Attempting to detach device vdb from instance 77f15843-a3a9-4943-a763-0901cd84d7ca from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:59:29 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:59:29 user nova-compute[82184]:   <source dev="/dev/sde"/>
Apr 12 01:59:29 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:59:29 user nova-compute[82184]:   <serial>16ef6179-f08e-48ff-80c4-d5301b48eecf</serial>
Apr 12 01:59:29 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:59:29 user nova-compute[82184]: </disk>
Apr 12 01:59:29 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:59:29 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Successfully detached device vdb from instance 77f15843-a3a9-4943-a763-0901cd84d7ca from the persistent domain config.
Apr 12 01:59:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77f15843-a3a9-4943-a763-0901cd84d7ca from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 01:59:29 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:59:29 user nova-compute[82184]:   <source dev="/dev/sde"/>
Apr 12 01:59:29 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 01:59:29 user nova-compute[82184]:   <serial>16ef6179-f08e-48ff-80c4-d5301b48eecf</serial>
Apr 12 01:59:29 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 01:59:29 user nova-compute[82184]: </disk>
Apr 12 01:59:29 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "77f15843-a3a9-4943-a763-0901cd84d7ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264769.9038737, 77f15843-a3a9-4943-a763-0901cd84d7ca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77f15843-a3a9-4943-a763-0901cd84d7ca {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 01:59:29 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Successfully detached device vdb from instance 77f15843-a3a9-4943-a763-0901cd84d7ca from the live domain config.
Apr 12 01:59:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VErqUzSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:59:29 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:59:29 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97cd036-6bd7-4986-8489-ee42090b4923]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:59:29 user nova-compute[82184]: No targets found.
Apr 12 01:59:29 user nova-compute[82184]: iSNS:
Apr 12 01:59:29 user nova-compute[82184]: No targets found.
Apr 12 01:59:29 user nova-compute[82184]: STATIC:
Apr 12 01:59:29 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf
Apr 12 01:59:29 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:59:29 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:59:29 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 01:59:29 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:59:29 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:59:29 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f
Apr 12 01:59:29 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:59:29 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:59:29 user nova-compute[82184]: FIRMWARE:
Apr 12 01:59:29 user nova-compute[82184]: No targets found.
Apr 12 01:59:29 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:59:29 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:59:29 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96414157-1a62-4333-8537-a86e77281d01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac289925-187a-41d6-97e2-25f82918ce11]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:30 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:30 user nova-compute[82184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf (non-flash)
Apr 12 01:59:30 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:30 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:30 user nova-compute[82184]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf (non-flash)
Apr 12 01:59:30 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b41b7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf'): ({'sde'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Removing single pathed devices sde {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5873de-02e0-4fac-b3ab-ac33c4f273d6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f144c53c-1336-4699-94fe-9acd5da28e4d]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Flushing IO for device /dev/sde {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8eb907-fbc9-406e-b858-51787f7a9d31]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42491f6-2ab3-42ab-8144-8215c77aab37]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] SCSI volumes sde have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d0f086-a554-4c1e-bf7c-4766e0361684]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f488979d-988b-4284-9a88-306638dec637]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf, portal: 172.16.0.220,3260]
Apr 12 01:59:30 user nova-compute[82184]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf, portal: 172.16.0.220,3260] successful.
Apr 12 01:59:30 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20941942-3763-4c86-9e83-f3ec7a39f895]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] <== disconnect_volume: return (329ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:59:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG nova.objects.instance [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'flavor' on Instance uuid 77f15843-a3a9-4943-a763-0901cd84d7ca {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3456cf07-4898-4923-9512-77641472c3e4 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.714s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.597s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:32 user nova-compute[82184]: INFO nova.compute.manager [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Terminating instance
Apr 12 01:59:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-43b2e4af-ce47-4827-8328-7bca604c3732 req-0bbf58cf-b360-4ba7-bca6-f6f5c016e29b service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Received event network-vif-unplugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-43b2e4af-ce47-4827-8328-7bca604c3732 req-0bbf58cf-b360-4ba7-bca6-f6f5c016e29b service nova] Acquiring lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-43b2e4af-ce47-4827-8328-7bca604c3732 req-0bbf58cf-b360-4ba7-bca6-f6f5c016e29b service nova] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-43b2e4af-ce47-4827-8328-7bca604c3732 req-0bbf58cf-b360-4ba7-bca6-f6f5c016e29b service nova] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-43b2e4af-ce47-4827-8328-7bca604c3732 req-0bbf58cf-b360-4ba7-bca6-f6f5c016e29b service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] No waiting events found dispatching network-vif-unplugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-43b2e4af-ce47-4827-8328-7bca604c3732 req-0bbf58cf-b360-4ba7-bca6-f6f5c016e29b service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Received event network-vif-unplugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 01:59:32 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Instance destroyed successfully.
Apr 12 01:59:32 user nova-compute[82184]: DEBUG nova.objects.instance [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'resources' on Instance uuid 77f15843-a3a9-4943-a763-0901cd84d7ca {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1188952548',display_name='tempest-VolumesSnapshotTestJSON-instance-1188952548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1188952548',id=20,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dbc688a91f547c0adbf929d0f714d51',ramdisk_id='',reservation_id='r-m9hkbtwg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1019440197',owner_user_name='tempest-VolumesSnapshotTestJSON-1019440197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:57:28Z,user_data=None,user_id='cb64ad9101674c1a92d41dfd57ca8e15',uuid=77f15843-a3a9-4943-a763-0901cd84d7ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "address": "fa:16:3e:f6:ce:52", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d413e3-0f", "ovs_interfaceid": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converting VIF {"id": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "address": "fa:16:3e:f6:ce:52", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00d413e3-0f", "ovs_interfaceid": "00d413e3-0f38-46cf-baf4-c5b61bbcf104", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=00d413e3-0f38-46cf-baf4-c5b61bbcf104,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d413e3-0f') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_vif [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=00d413e3-0f38-46cf-baf4-c5b61bbcf104,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d413e3-0f') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00d413e3-0f, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:59:33 user nova-compute[82184]: INFO os_vif [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ce:52,bridge_name='br-int',has_traffic_filtering=True,id=00d413e3-0f38-46cf-baf4-c5b61bbcf104,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00d413e3-0f')
Apr 12 01:59:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VErqUzSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:59:33 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7242b2f3-e6cb-4f10-b4e6-52df2fe0f99c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 01:59:33 user nova-compute[82184]: No targets found.
Apr 12 01:59:33 user nova-compute[82184]: iSNS:
Apr 12 01:59:33 user nova-compute[82184]: No targets found.
Apr 12 01:59:33 user nova-compute[82184]: STATIC:
Apr 12 01:59:33 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 01:59:33 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:59:33 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:59:33 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f
Apr 12 01:59:33 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 01:59:33 user nova-compute[82184]:                 Iface Name: default
Apr 12 01:59:33 user nova-compute[82184]: FIRMWARE:
Apr 12 01:59:33 user nova-compute[82184]: No targets found.
Apr 12 01:59:33 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 01:59:33 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 01:59:33 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16ef6179-f08e-48ff-80c4-d5301b48eecf', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf10fe76-8bda-44a6-968a-6a9e21880cc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cd3b7b-d14a-4e6a-9148-aa1c04512613]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:33 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:33 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:33 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:33 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a82108b0>, {}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Disconnecting from: [] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] <== disconnect_volume: return (86ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 01:59:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Deleting instance files /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca_del
Apr 12 01:59:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Deletion of /opt/stack/data/nova/instances/77f15843-a3a9-4943-a763-0901cd84d7ca_del complete
Apr 12 01:59:33 user nova-compute[82184]: INFO nova.compute.manager [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Took 1.13 seconds to destroy the instance on the hypervisor.
Apr 12 01:59:33 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 01:59:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:59:34 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Took 0.96 seconds to deallocate network for instance.
Apr 12 01:59:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e0dd4af-0cc1-4856-b8d5-4e043be5e533 req-741f42b6-a023-461c-81e2-2e5e28a812d8 service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Received event network-vif-deleted-00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:34 user nova-compute[82184]: WARNING nova.volume.cinder [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Attachment e334de42-65d8-4009-8920-9a8e2536bc05 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e334de42-65d8-4009-8920-9a8e2536bc05. (HTTP 404) (Request-ID: req-8513dfb7-cf8f-4ac2-802f-154da76f7f01)
Apr 12 01:59:34 user nova-compute[82184]: INFO nova.compute.manager [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Took 0.03 seconds to detach 1 volumes for instance.
Apr 12 01:59:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:34 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Deleted allocations for instance 77f15843-a3a9-4943-a763-0901cd84d7ca
Apr 12 01:59:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-33c81f30-c9ad-4eff-90d3-38ec50a15e76 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.668s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-8bfdc8fb-2747-4489-9001-e99280a433c6 req-2764fee1-5300-4a7b-940d-2929ab756c1e service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Received event network-vif-plugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8bfdc8fb-2747-4489-9001-e99280a433c6 req-2764fee1-5300-4a7b-940d-2929ab756c1e service nova] Acquiring lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8bfdc8fb-2747-4489-9001-e99280a433c6 req-2764fee1-5300-4a7b-940d-2929ab756c1e service nova] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8bfdc8fb-2747-4489-9001-e99280a433c6 req-2764fee1-5300-4a7b-940d-2929ab756c1e service nova] Lock "77f15843-a3a9-4943-a763-0901cd84d7ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-8bfdc8fb-2747-4489-9001-e99280a433c6 req-2764fee1-5300-4a7b-940d-2929ab756c1e service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] No waiting events found dispatching network-vif-plugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:34 user nova-compute[82184]: WARNING nova.compute.manager [req-8bfdc8fb-2747-4489-9001-e99280a433c6 req-2764fee1-5300-4a7b-940d-2929ab756c1e service nova] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Received unexpected event network-vif-plugged-00d413e3-0f38-46cf-baf4-c5b61bbcf104 for instance with vm_state deleted and task_state None.
Apr 12 01:59:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:59:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:39 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:59:39 user nova-compute[82184]: INFO nova.compute.claims [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Claim successful on node user
Apr 12 01:59:39 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:59:39 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:59:40 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:59:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG nova.policy [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '189b7aba48014bedacfa021cc3cad5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2acf278c981e481fbe43e415c76aa6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264765.2366014, cb89325c-680a-4413-8e94-4eddfaa79c6b => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:59:40 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] VM Stopped (Lifecycle Event)
Apr 12 01:59:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:59:40 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Creating image(s)
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "/opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "/opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "/opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-dc001f3d-fca7-4f41-bb7c-67cf0b0048dc None None] [instance: cb89325c-680a-4413-8e94-4eddfaa79c6b] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.183s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.174s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk 1073741824" returned: 0 in 0.057s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.175s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 01:59:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Cannot resize image /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'migration_context' on Instance uuid 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Ensure instance console log exists: /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Successfully created port: bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Successfully updated port: bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquired lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-81d371f9-4466-47da-a369-a0cc909b1719 req-7c711d3a-b1c4-443c-ba2b-5f2a7d88224e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received event network-changed-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-81d371f9-4466-47da-a369-a0cc909b1719 req-7c711d3a-b1c4-443c-ba2b-5f2a7d88224e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Refreshing instance network info cache due to event network-changed-bc0f00ae-1855-439a-a945-9cc72e70fcc4. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-81d371f9-4466-47da-a369-a0cc909b1719 req-7c711d3a-b1c4-443c-ba2b-5f2a7d88224e service nova] Acquiring lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:59:41 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Updating instance_info_cache with network_info: [{"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Releasing lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Instance network_info: |[{"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-81d371f9-4466-47da-a369-a0cc909b1719 req-7c711d3a-b1c4-443c-ba2b-5f2a7d88224e service nova] Acquired lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.network.neutron [req-81d371f9-4466-47da-a369-a0cc909b1719 req-7c711d3a-b1c4-443c-ba2b-5f2a7d88224e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Refreshing network info cache for port bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Start _get_guest_xml network_info=[{"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:59:42 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:59:42 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-376857066',display_name='tempest-AttachVolumeNegativeTest-server-376857066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-376857066',id=22,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyQPgNnY+n5pmjFnlz3V3O4w81ZzobntB8dh+2yVFNBNym/eGJJo7urnH/zX2dzy5CA7558+VofCPs+9Vde/YZ1+ziQKJzVrqQuhHVBk0QzvwcemmNSiwyqvFvAu2VGhg==',key_name='tempest-keypair-97228139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-ykbik2fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc0f00ae-1855-439a-a945-9cc72e70fcc4,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0f00ae-18') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'pci_devices' on Instance uuid 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:59:42 user nova-compute[82184]:   <uuid>92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd</uuid>
Apr 12 01:59:42 user nova-compute[82184]:   <name>instance-00000016</name>
Apr 12 01:59:42 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:59:42 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:59:42 user nova-compute[82184]:   <metadata>
Apr 12 01:59:42 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:59:42 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:59:42 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeNegativeTest-server-376857066</nova:name>
Apr 12 01:59:42 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:59:42</nova:creationTime>
Apr 12 01:59:42 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:59:42 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:59:42 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:59:42 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:59:42 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:59:42 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:59:42 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:59:42 user nova-compute[82184]:       <nova:owner>
Apr 12 01:59:42 user nova-compute[82184]:         <nova:user uuid="189b7aba48014bedacfa021cc3cad5e4">tempest-AttachVolumeNegativeTest-1849748479-project-member</nova:user>
Apr 12 01:59:42 user nova-compute[82184]:         <nova:project uuid="2acf278c981e481fbe43e415c76aa6e7">tempest-AttachVolumeNegativeTest-1849748479</nova:project>
Apr 12 01:59:42 user nova-compute[82184]:       </nova:owner>
Apr 12 01:59:42 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 01:59:42 user nova-compute[82184]:       <nova:ports>
Apr 12 01:59:42 user nova-compute[82184]:         <nova:port uuid="bc0f00ae-1855-439a-a945-9cc72e70fcc4">
Apr 12 01:59:42 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 01:59:42 user nova-compute[82184]:         </nova:port>
Apr 12 01:59:42 user nova-compute[82184]:       </nova:ports>
Apr 12 01:59:42 user nova-compute[82184]:     </nova:instance>
Apr 12 01:59:42 user nova-compute[82184]:   </metadata>
Apr 12 01:59:42 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:59:42 user nova-compute[82184]:     <system>
Apr 12 01:59:42 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:59:42 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:59:42 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:59:42 user nova-compute[82184]:       <entry name="serial">92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd</entry>
Apr 12 01:59:42 user nova-compute[82184]:       <entry name="uuid">92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd</entry>
Apr 12 01:59:42 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:59:42 user nova-compute[82184]:     </system>
Apr 12 01:59:42 user nova-compute[82184]:   </sysinfo>
Apr 12 01:59:42 user nova-compute[82184]:   <os>
Apr 12 01:59:42 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:59:42 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:59:42 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:59:42 user nova-compute[82184]:   </os>
Apr 12 01:59:42 user nova-compute[82184]:   <features>
Apr 12 01:59:42 user nova-compute[82184]:     <acpi/>
Apr 12 01:59:42 user nova-compute[82184]:     <apic/>
Apr 12 01:59:42 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:59:42 user nova-compute[82184]:   </features>
Apr 12 01:59:42 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:59:42 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:59:42 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:59:42 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:59:42 user nova-compute[82184]:   </clock>
Apr 12 01:59:42 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:59:42 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:59:42 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:59:42 user nova-compute[82184]:   </cpu>
Apr 12 01:59:42 user nova-compute[82184]:   <devices>
Apr 12 01:59:42 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 01:59:42 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 01:59:42 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk"/>
Apr 12 01:59:42 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:59:42 user nova-compute[82184]:     </disk>
Apr 12 01:59:42 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:59:42 user nova-compute[82184]:       <mac address="fa:16:3e:92:85:d6"/>
Apr 12 01:59:42 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:59:42 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:59:42 user nova-compute[82184]:       <target dev="tapbc0f00ae-18"/>
Apr 12 01:59:42 user nova-compute[82184]:     </interface>
Apr 12 01:59:42 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:59:42 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/console.log" append="off"/>
Apr 12 01:59:42 user nova-compute[82184]:     </serial>
Apr 12 01:59:42 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:59:42 user nova-compute[82184]:     <video>
Apr 12 01:59:42 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:59:42 user nova-compute[82184]:     </video>
Apr 12 01:59:42 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:59:42 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:59:42 user nova-compute[82184]:     </rng>
Apr 12 01:59:42 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:59:42 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:59:42 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:59:42 user nova-compute[82184]:     </memballoon>
Apr 12 01:59:42 user nova-compute[82184]:   </devices>
Apr 12 01:59:42 user nova-compute[82184]: </domain>
Apr 12 01:59:42 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-376857066',display_name='tempest-AttachVolumeNegativeTest-server-376857066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-376857066',id=22,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyQPgNnY+n5pmjFnlz3V3O4w81ZzobntB8dh+2yVFNBNym/eGJJo7urnH/zX2dzy5CA7558+VofCPs+9Vde/YZ1+ziQKJzVrqQuhHVBk0QzvwcemmNSiwyqvFvAu2VGhg==',key_name='tempest-keypair-97228139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-ykbik2fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc0f00ae-1855-439a-a945-9cc72e70fcc4,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0f00ae-18') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG os_vif [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc0f00ae-1855-439a-a945-9cc72e70fcc4,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0f00ae-18') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc0f00ae-18, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc0f00ae-18, col_values=(('external_ids', {'iface-id': 'bc0f00ae-1855-439a-a945-9cc72e70fcc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:85:d6', 'vm-uuid': '92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:42 user nova-compute[82184]: INFO os_vif [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc0f00ae-1855-439a-a945-9cc72e70fcc4,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0f00ae-18')
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No VIF found with MAC fa:16:3e:92:85:d6, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.network.neutron [req-81d371f9-4466-47da-a369-a0cc909b1719 req-7c711d3a-b1c4-443c-ba2b-5f2a7d88224e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Updated VIF entry in instance network info cache for port bc0f00ae-1855-439a-a945-9cc72e70fcc4. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:59:42 user nova-compute[82184]: DEBUG nova.network.neutron [req-81d371f9-4466-47da-a369-a0cc909b1719 req-7c711d3a-b1c4-443c-ba2b-5f2a7d88224e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Updating instance_info_cache with network_info: [{"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:59:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-81d371f9-4466-47da-a369-a0cc909b1719 req-7c711d3a-b1c4-443c-ba2b-5f2a7d88224e service nova] Releasing lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:59:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 01:59:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 01:59:43 user nova-compute[82184]: INFO nova.compute.claims [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Claim successful on node user
Apr 12 01:59:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-676adec5-936d-4c34-818b-e5f968ea2d6b req-89f3a742-ba71-4c1e-a6f5-b361fc82bd9e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received event network-vif-plugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-676adec5-936d-4c34-818b-e5f968ea2d6b req-89f3a742-ba71-4c1e-a6f5-b361fc82bd9e service nova] Acquiring lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-676adec5-936d-4c34-818b-e5f968ea2d6b req-89f3a742-ba71-4c1e-a6f5-b361fc82bd9e service nova] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-676adec5-936d-4c34-818b-e5f968ea2d6b req-89f3a742-ba71-4c1e-a6f5-b361fc82bd9e service nova] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-676adec5-936d-4c34-818b-e5f968ea2d6b req-89f3a742-ba71-4c1e-a6f5-b361fc82bd9e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] No waiting events found dispatching network-vif-plugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:44 user nova-compute[82184]: WARNING nova.compute.manager [req-676adec5-936d-4c34-818b-e5f968ea2d6b req-89f3a742-ba71-4c1e-a6f5-b361fc82bd9e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received unexpected event network-vif-plugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 for instance with vm_state building and task_state spawning.
Apr 12 01:59:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 01:59:44 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 01:59:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 01:59:44 user nova-compute[82184]: INFO nova.virt.block_device [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Booting with volume 11d89fd1-2c63-48c0-8341-1af121bc4cc7 at /dev/vda
Apr 12 01:59:44 user nova-compute[82184]: DEBUG os_brick.utils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[813b8b24-d0de-4eef-a5a5-17dae1e79fc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8632fa-da6c-40cc-93bf-0bf1b4eea026]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fcfa7a-f9f0-4f8b-b376-c590b4aed166]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5c44b4-5553-44a4-9700-bb67c98e5eaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 01:59:44 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 01:59:44 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd870655-1a81-444f-9e74-062552ca5c02]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG os_brick.utils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating existing volume attachment record: bd965767-8859-40f4-9047-a895701cd40f {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:44 user nova-compute[82184]: DEBUG nova.policy [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5108c5bde1e249a2934f3e47496b1027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97353e0d7e084a1095d6ae46416d5660', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 01:59:45 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Successfully created port: b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-168841d1-8f59-4c3c-9000-126000c4f393 req-d00e4c59-42e3-4a2c-a5cb-5d976511529e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received event network-vif-plugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-168841d1-8f59-4c3c-9000-126000c4f393 req-d00e4c59-42e3-4a2c-a5cb-5d976511529e service nova] Acquiring lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-168841d1-8f59-4c3c-9000-126000c4f393 req-d00e4c59-42e3-4a2c-a5cb-5d976511529e service nova] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-168841d1-8f59-4c3c-9000-126000c4f393 req-d00e4c59-42e3-4a2c-a5cb-5d976511529e service nova] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-168841d1-8f59-4c3c-9000-126000c4f393 req-d00e4c59-42e3-4a2c-a5cb-5d976511529e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] No waiting events found dispatching network-vif-plugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:46 user nova-compute[82184]: WARNING nova.compute.manager [req-168841d1-8f59-4c3c-9000-126000c4f393 req-d00e4c59-42e3-4a2c-a5cb-5d976511529e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received unexpected event network-vif-plugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 for instance with vm_state building and task_state spawning.
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264786.27941, 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:59:46 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] VM Resumed (Lifecycle Event)
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:59:46 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Instance spawned successfully.
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:46 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264786.2868192, 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:59:46 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] VM Started (Lifecycle Event)
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:59:46 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:59:46 user nova-compute[82184]: INFO nova.compute.manager [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Took 6.14 seconds to spawn the instance on the hypervisor.
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Successfully updated port: b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquired lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:59:46 user nova-compute[82184]: INFO nova.compute.manager [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Took 6.86 seconds to build instance.
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4e840369-9510-416b-a48d-d64881b79adf tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.971s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating instance_info_cache with network_info: [{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Releasing lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Instance network_info: |[{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 01:59:46 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:47 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264772.981002, 77f15843-a3a9-4943-a763-0901cd84d7ca => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:59:47 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] VM Stopped (Lifecycle Event)
Apr 12 01:59:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e23c5329-2e13-4743-bdb4-623cbb07d42b None None] [instance: 77f15843-a3a9-4943-a763-0901cd84d7ca] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:48 user nova-compute[82184]: INFO nova.compute.manager [None req-100a920d-d10a-49ef-969a-37ea33639fba tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Unrescuing
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-100a920d-d10a-49ef-969a-37ea33639fba tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-100a920d-d10a-49ef-969a-37ea33639fba tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquired lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-100a920d-d10a-49ef-969a-37ea33639fba tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-6853cdf7-9a35-4d5e-bca0-0e78e9184f5a req-d2b6aedc-8a91-4a3a-9350-ab21b9f08d05 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-changed-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-6853cdf7-9a35-4d5e-bca0-0e78e9184f5a req-d2b6aedc-8a91-4a3a-9350-ab21b9f08d05 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Refreshing instance network info cache due to event network-changed-b64bd49d-20d0-4f9d-b07c-078a55b0542f. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6853cdf7-9a35-4d5e-bca0-0e78e9184f5a req-d2b6aedc-8a91-4a3a-9350-ab21b9f08d05 service nova] Acquiring lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6853cdf7-9a35-4d5e-bca0-0e78e9184f5a req-d2b6aedc-8a91-4a3a-9350-ab21b9f08d05 service nova] Acquired lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG nova.network.neutron [req-6853cdf7-9a35-4d5e-bca0-0e78e9184f5a req-d2b6aedc-8a91-4a3a-9350-ab21b9f08d05 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Refreshing network info cache for port b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-100a920d-d10a-49ef-969a-37ea33639fba tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating instance_info_cache with network_info: [{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-100a920d-d10a-49ef-969a-37ea33639fba tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Releasing lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-100a920d-d10a-49ef-969a-37ea33639fba tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'flavor' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-6853cdf7-9a35-4d5e-bca0-0e78e9184f5a req-d2b6aedc-8a91-4a3a-9350-ab21b9f08d05 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updated VIF entry in instance network info cache for port b64bd49d-20d0-4f9d-b07c-078a55b0542f. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-6853cdf7-9a35-4d5e-bca0-0e78e9184f5a req-d2b6aedc-8a91-4a3a-9350-ab21b9f08d05 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating instance_info_cache with network_info: [{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6853cdf7-9a35-4d5e-bca0-0e78e9184f5a req-d2b6aedc-8a91-4a3a-9350-ab21b9f08d05 service nova] Releasing lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:50 user nova-compute[82184]: WARNING nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-changed-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Refreshing instance network info cache due to event network-changed-77c37f41-cbd9-4b96-a5e7-103d187fce32. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Acquiring lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Acquired lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.network.neutron [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Refreshing network info cache for port 77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:59:50 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Instance destroyed successfully.
Apr 12 01:59:50 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:59:50 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8065MB free_disk=26.408355712890625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Applying migration context for instance c712f2db-72cb-4136-a719-56057d82fff6 as it has an incoming, in-progress migration 7687ad16-d1d8-435d-8780-facafbde3a7a. Migration status is finished {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 01:59:50 user nova-compute[82184]: INFO nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating resource usage from migration 7687ad16-d1d8-435d-8780-facafbde3a7a
Apr 12 01:59:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 01:59:50 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Creating image(s)
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Ensure instance console log exists: /opt/stack/data/nova/instances/b8c39c58-73b3-4574-9fcf-0c5901a81aa0/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Start _get_guest_xml network_info=[{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'bd965767-8859-40f4-9047-a895701cd40f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEchyUgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8c39c58-73b3-4574-9fcf-0c5901a81aa0', 'attached_at': '', 'detached_at': '', 'volume_id': '11d89fd1-2c63-48c0-8341-1af121bc4cc7', 'serial': '11d89fd1-2c63-48c0-8341-1af121bc4cc7'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 84b4902c-24d9-4e96-b51f-e93e913aa681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Migration 7687ad16-d1d8-435d-8780-facafbde3a7a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance b8c39c58-73b3-4574-9fcf-0c5901a81aa0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:50 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:59:50 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEchyUgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 01:59:50 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:59:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:59:50 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 01:59:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 01:59:50 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 01:59:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12a4e2e-5e2b-4737-a7dc-e71cefa079ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 01:59:50 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b41c10c-82e7-48c7-a083-ea732a138f8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7] added
Apr 12 01:59:50 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4dc923-8d5e-4f1c-bba7-e2143c0f7218]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e895a1dd-75d1-40ef-a7b3-655ed6f73fe8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEchyUgX {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEchyUgX" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8530ab83-17a0-451f-b649-9b6216a64dee]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AEchyUgX'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ca496d-072c-449a-9085-ae4c4d8e7c1b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820270b-5c89-4559-8d31-9df28e094317]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:51 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:51 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:51 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:51 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea780ee1-2534-41b4-ac98-2b2aba0bd612]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260]
Apr 12 01:59:51 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260] successful.
Apr 12 01:59:51 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae1f367-22d4-4c06-959c-590fd2d6c5fc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.network.neutron [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updated VIF entry in instance network info cache for port 77c37f41-cbd9-4b96-a5e7-103d187fce32. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.network.neutron [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating instance_info_cache with network_info: [{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f16b6c-e2be-4693-b140-4e8f558995af]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:51 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:51 user nova-compute[82184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 01:59:51 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 01:59:51 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 01:59:51 user nova-compute[82184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 01:59:51 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Releasing lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-changed-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Refreshing instance network info cache due to event network-changed-77c37f41-cbd9-4b96-a5e7-103d187fce32. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Acquiring lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Acquired lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.network.neutron [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Refreshing network info cache for port 77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a1bd3-e58a-4b16-9c9e-53517a24f5d8]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEchyUgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.network.neutron [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updated VIF entry in instance network info cache for port 77c37f41-cbd9-4b96-a5e7-103d187fce32. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.network.neutron [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating instance_info_cache with network_info: [{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Releasing lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:51 user nova-compute[82184]: WARNING nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:51 user nova-compute[82184]: WARNING nova.compute.manager [req-5258a66b-91e9-42d0-a843-fa084a035037 req-c6c603f9-4e7f-4a05-b94f-bc95c4e40d67 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23734336161353763', 'path': '/dev/sdd'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734336161353763', 'path': '/dev/sdd'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-662581423',display_name='tempest-TestShelveInstance-server-662581423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-662581423',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzJEkyxrgGdFi9xp4HEHo6h+HMI/sf0D1BEcLp1PlBC0aEIXZkpEAZB7dj1l2oKNIXETzcME23LJ7KETYvsoSN/f9VetiXUt+tFF8xxyxwD7zg/09NP8sJhNpL272IgEg==',key_name='tempest-TestShelveInstance-269156000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97353e0d7e084a1095d6ae46416d5660',ramdisk_id='',reservation_id='r-68gx34k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1070508789',owner_user_name='tempest-TestShelveInstance-1070508789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:59:44Z,user_data=None,user_id='5108c5bde1e249a2934f3e47496b1027',uuid=b8c39c58-73b3-4574-9fcf-0c5901a81aa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converting VIF {"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lazy-loading 'pci_devices' on Instance uuid b8c39c58-73b3-4574-9fcf-0c5901a81aa0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 01:59:52 user nova-compute[82184]:   <uuid>b8c39c58-73b3-4574-9fcf-0c5901a81aa0</uuid>
Apr 12 01:59:52 user nova-compute[82184]:   <name>instance-00000017</name>
Apr 12 01:59:52 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 01:59:52 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 01:59:52 user nova-compute[82184]:   <metadata>
Apr 12 01:59:52 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 01:59:52 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 01:59:52 user nova-compute[82184]:       <nova:name>tempest-TestShelveInstance-server-662581423</nova:name>
Apr 12 01:59:52 user nova-compute[82184]:       <nova:creationTime>2023-04-12 01:59:50</nova:creationTime>
Apr 12 01:59:52 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 01:59:52 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 01:59:52 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 01:59:52 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 01:59:52 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 01:59:52 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 01:59:52 user nova-compute[82184]:       </nova:flavor>
Apr 12 01:59:52 user nova-compute[82184]:       <nova:owner>
Apr 12 01:59:52 user nova-compute[82184]:         <nova:user uuid="5108c5bde1e249a2934f3e47496b1027">tempest-TestShelveInstance-1070508789-project-member</nova:user>
Apr 12 01:59:52 user nova-compute[82184]:         <nova:project uuid="97353e0d7e084a1095d6ae46416d5660">tempest-TestShelveInstance-1070508789</nova:project>
Apr 12 01:59:52 user nova-compute[82184]:       </nova:owner>
Apr 12 01:59:52 user nova-compute[82184]:       <nova:ports>
Apr 12 01:59:52 user nova-compute[82184]:         <nova:port uuid="b64bd49d-20d0-4f9d-b07c-078a55b0542f">
Apr 12 01:59:52 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 01:59:52 user nova-compute[82184]:         </nova:port>
Apr 12 01:59:52 user nova-compute[82184]:       </nova:ports>
Apr 12 01:59:52 user nova-compute[82184]:     </nova:instance>
Apr 12 01:59:52 user nova-compute[82184]:   </metadata>
Apr 12 01:59:52 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 01:59:52 user nova-compute[82184]:     <system>
Apr 12 01:59:52 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 01:59:52 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 01:59:52 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 01:59:52 user nova-compute[82184]:       <entry name="serial">b8c39c58-73b3-4574-9fcf-0c5901a81aa0</entry>
Apr 12 01:59:52 user nova-compute[82184]:       <entry name="uuid">b8c39c58-73b3-4574-9fcf-0c5901a81aa0</entry>
Apr 12 01:59:52 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 01:59:52 user nova-compute[82184]:     </system>
Apr 12 01:59:52 user nova-compute[82184]:   </sysinfo>
Apr 12 01:59:52 user nova-compute[82184]:   <os>
Apr 12 01:59:52 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 01:59:52 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 01:59:52 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 01:59:52 user nova-compute[82184]:   </os>
Apr 12 01:59:52 user nova-compute[82184]:   <features>
Apr 12 01:59:52 user nova-compute[82184]:     <acpi/>
Apr 12 01:59:52 user nova-compute[82184]:     <apic/>
Apr 12 01:59:52 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 01:59:52 user nova-compute[82184]:   </features>
Apr 12 01:59:52 user nova-compute[82184]:   <clock offset="utc">
Apr 12 01:59:52 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 01:59:52 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 01:59:52 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 01:59:52 user nova-compute[82184]:   </clock>
Apr 12 01:59:52 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 01:59:52 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 01:59:52 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 01:59:52 user nova-compute[82184]:   </cpu>
Apr 12 01:59:52 user nova-compute[82184]:   <devices>
Apr 12 01:59:52 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 01:59:52 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 01:59:52 user nova-compute[82184]:       <source dev="/dev/sdd"/>
Apr 12 01:59:52 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 01:59:52 user nova-compute[82184]:       <serial>11d89fd1-2c63-48c0-8341-1af121bc4cc7</serial>
Apr 12 01:59:52 user nova-compute[82184]:     </disk>
Apr 12 01:59:52 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 01:59:52 user nova-compute[82184]:       <mac address="fa:16:3e:13:82:50"/>
Apr 12 01:59:52 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:59:52 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 01:59:52 user nova-compute[82184]:       <target dev="tapb64bd49d-20"/>
Apr 12 01:59:52 user nova-compute[82184]:     </interface>
Apr 12 01:59:52 user nova-compute[82184]:     <serial type="pty">
Apr 12 01:59:52 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/b8c39c58-73b3-4574-9fcf-0c5901a81aa0/console.log" append="off"/>
Apr 12 01:59:52 user nova-compute[82184]:     </serial>
Apr 12 01:59:52 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 01:59:52 user nova-compute[82184]:     <video>
Apr 12 01:59:52 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 01:59:52 user nova-compute[82184]:     </video>
Apr 12 01:59:52 user nova-compute[82184]:     <rng model="virtio">
Apr 12 01:59:52 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 01:59:52 user nova-compute[82184]:     </rng>
Apr 12 01:59:52 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 01:59:52 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 01:59:52 user nova-compute[82184]:       <stats period="10"/>
Apr 12 01:59:52 user nova-compute[82184]:     </memballoon>
Apr 12 01:59:52 user nova-compute[82184]:   </devices>
Apr 12 01:59:52 user nova-compute[82184]: </domain>
Apr 12 01:59:52 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-662581423',display_name='tempest-TestShelveInstance-server-662581423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-662581423',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzJEkyxrgGdFi9xp4HEHo6h+HMI/sf0D1BEcLp1PlBC0aEIXZkpEAZB7dj1l2oKNIXETzcME23LJ7KETYvsoSN/f9VetiXUt+tFF8xxyxwD7zg/09NP8sJhNpL272IgEg==',key_name='tempest-TestShelveInstance-269156000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97353e0d7e084a1095d6ae46416d5660',ramdisk_id='',reservation_id='r-68gx34k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1070508789',owner_user_name='tempest-TestShelveInstance-1070508789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:59:44Z,user_data=None,user_id='5108c5bde1e249a2934f3e47496b1027',uuid=b8c39c58-73b3-4574-9fcf-0c5901a81aa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converting VIF {"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG os_vif [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb64bd49d-20, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb64bd49d-20, col_values=(('external_ids', {'iface-id': 'b64bd49d-20d0-4f9d-b07c-078a55b0542f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:82:50', 'vm-uuid': 'b8c39c58-73b3-4574-9fcf-0c5901a81aa0'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: INFO os_vif [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20')
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:52 user nova-compute[82184]: WARNING nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:52 user nova-compute[82184]: WARNING nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:52 user nova-compute[82184]: WARNING nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:52 user nova-compute[82184]: WARNING nova.compute.manager [req-a1de25a2-ee46-4a12-a555-37b3ad85f2f7 req-4704818b-2d74-4835-b6cb-0602cfd2f399 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] No VIF found with MAC fa:16:3e:13:82:50, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updating instance_info_cache with network_info: [{"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:59:52 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:59:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:59:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 01:59:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-6b88437a-0637-4da5-a750-0edd7bb99797 req-4331277a-95b8-44f6-b320-d211f4bae88d service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6b88437a-0637-4da5-a750-0edd7bb99797 req-4331277a-95b8-44f6-b320-d211f4bae88d service nova] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6b88437a-0637-4da5-a750-0edd7bb99797 req-4331277a-95b8-44f6-b320-d211f4bae88d service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6b88437a-0637-4da5-a750-0edd7bb99797 req-4331277a-95b8-44f6-b320-d211f4bae88d service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-6b88437a-0637-4da5-a750-0edd7bb99797 req-4331277a-95b8-44f6-b320-d211f4bae88d service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] No waiting events found dispatching network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:54 user nova-compute[82184]: WARNING nova.compute.manager [req-6b88437a-0637-4da5-a750-0edd7bb99797 req-4331277a-95b8-44f6-b320-d211f4bae88d service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received unexpected event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f for instance with vm_state building and task_state spawning.
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264794.4862132, 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:59:54 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] VM Resumed (Lifecycle Event)
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-100a920d-d10a-49ef-969a-37ea33639fba tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-77e0fb7e-ae5e-4a1e-8098-bde6b9abeec7 req-c7d5179b-3852-4a35-8016-5dc967548643 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-77e0fb7e-ae5e-4a1e-8098-bde6b9abeec7 req-c7d5179b-3852-4a35-8016-5dc967548643 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-77e0fb7e-ae5e-4a1e-8098-bde6b9abeec7 req-c7d5179b-3852-4a35-8016-5dc967548643 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-77e0fb7e-ae5e-4a1e-8098-bde6b9abeec7 req-c7d5179b-3852-4a35-8016-5dc967548643 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-77e0fb7e-ae5e-4a1e-8098-bde6b9abeec7 req-c7d5179b-3852-4a35-8016-5dc967548643 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:54 user nova-compute[82184]: WARNING nova.compute.manager [req-77e0fb7e-ae5e-4a1e-8098-bde6b9abeec7 req-c7d5179b-3852-4a35-8016-5dc967548643 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state rescued and task_state unrescuing.
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:59:54 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264794.495176, 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:59:54 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] VM Started (Lifecycle Event)
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-8821393e-a0ab-41e0-b5b0-97d9645f398d req-13bfcdda-3d7a-4227-beab-024ff07a59ef service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8821393e-a0ab-41e0-b5b0-97d9645f398d req-13bfcdda-3d7a-4227-beab-024ff07a59ef service nova] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8821393e-a0ab-41e0-b5b0-97d9645f398d req-13bfcdda-3d7a-4227-beab-024ff07a59ef service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8821393e-a0ab-41e0-b5b0-97d9645f398d req-13bfcdda-3d7a-4227-beab-024ff07a59ef service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-8821393e-a0ab-41e0-b5b0-97d9645f398d req-13bfcdda-3d7a-4227-beab-024ff07a59ef service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] No waiting events found dispatching network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 01:59:56 user nova-compute[82184]: WARNING nova.compute.manager [req-8821393e-a0ab-41e0-b5b0-97d9645f398d req-13bfcdda-3d7a-4227-beab-024ff07a59ef service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received unexpected event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f for instance with vm_state building and task_state spawning.
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264796.1241777, b8c39c58-73b3-4574-9fcf-0c5901a81aa0 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:59:56 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] VM Resumed (Lifecycle Event)
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 01:59:56 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Instance spawned successfully.
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:59:56 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264796.125382, b8c39c58-73b3-4574-9fcf-0c5901a81aa0 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 01:59:56 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] VM Started (Lifecycle Event)
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 01:59:56 user nova-compute[82184]: INFO nova.compute.manager [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Took 5.48 seconds to spawn the instance on the hypervisor.
Apr 12 01:59:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 01:59:56 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 01:59:56 user nova-compute[82184]: INFO nova.compute.manager [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Took 12.71 seconds to build instance.
Apr 12 01:59:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 01:59:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5dc48ab-71e7-438e-8d77-c6909fd6c246 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.011s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 01:59:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-e664f1bc-0e24-4273-8291-29351539d226 req-0b7de438-68bf-4e7e-8773-19b4d2f5f5f7 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-changed-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-e664f1bc-0e24-4273-8291-29351539d226 req-0b7de438-68bf-4e7e-8773-19b4d2f5f5f7 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Refreshing instance network info cache due to event network-changed-b1709cc0-5e25-4f89-aa42-8bc0a424adc1. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e664f1bc-0e24-4273-8291-29351539d226 req-0b7de438-68bf-4e7e-8773-19b4d2f5f5f7 service nova] Acquiring lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e664f1bc-0e24-4273-8291-29351539d226 req-0b7de438-68bf-4e7e-8773-19b4d2f5f5f7 service nova] Acquired lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG nova.network.neutron [req-e664f1bc-0e24-4273-8291-29351539d226 req-0b7de438-68bf-4e7e-8773-19b4d2f5f5f7 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Refreshing network info cache for port b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG nova.objects.instance [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'flavor' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:10 user nova-compute[82184]: INFO nova.compute.manager [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Attaching volume f6f462d6-7d7c-4843-97c3-d0ded790997f to /dev/vdb
Apr 12 02:00:11 user nova-compute[82184]: DEBUG os_brick.utils [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0793a467-7bba-4af4-9f89-8699820aa39c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3f3778-0dcf-410b-93f9-112a1116eeeb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dc7c42-1a21-49c7-a657-bc3ace3c1548]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8cbde3-34a8-42d2-ad04-e3d540174e28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:00:11 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[684bdfa1-8146-4934-9cc8-696731831a66]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG os_brick.utils [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updating existing volume attachment record: d8068488-4178-4b75-b2ae-ed52f48764be {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-e664f1bc-0e24-4273-8291-29351539d226 req-0b7de438-68bf-4e7e-8773-19b4d2f5f5f7 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updated VIF entry in instance network info cache for port b1709cc0-5e25-4f89-aa42-8bc0a424adc1. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-e664f1bc-0e24-4273-8291-29351539d226 req-0b7de438-68bf-4e7e-8773-19b4d2f5f5f7 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updating instance_info_cache with network_info: [{"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:00:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e664f1bc-0e24-4273-8291-29351539d226 req-0b7de438-68bf-4e7e-8773-19b4d2f5f5f7 service nova] Releasing lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:00:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRnCtxap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:00:15 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:00:15 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:00:15 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4fa54a-fd34-4531-9a59-ca3ad75f6ba0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:00:15 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3244cf8a-a9f5-4eac-94ca-eae41018c7c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f] added
Apr 12 02:00:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[083abe77-1e20-4251-aa6e-5bfb23b1122f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a62fe3f-2233-4b9b-8e51-5210875c4ba4]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRnCtxap {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NRnCtxap" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d67d709-6472-4a23-9381-f66ff1b7843e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NRnCtxap'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b209d38-00fd-4487-a184-ae26d087c958]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[435f26a5-2214-467a-b6e0-9b884445b2c9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 02:00:15 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:00:15 user nova-compute[82184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 02:00:15 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:00:15 user nova-compute[82184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae7b06b-a245-44a2-932f-82e357ccd6f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f, portal: 172.16.0.220,3260]
Apr 12 02:00:15 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f, portal: 172.16.0.220,3260] successful.
Apr 12 02:00:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81ebb85-9ef8-4bff-bb13-abae3253e0e5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97310e9-1201-4506-ae72-b05a36f0f39c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 02:00:15 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:00:15 user nova-compute[82184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:15 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:00:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 02:00:15 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:00:15 user nova-compute[82184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:15 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:00:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8b2a59-c244-4fe9-a0f4-d32edb0d7577]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRnCtxap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:00:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:00:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23963396364353661', 'path': '/dev/sde'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:00:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963396364353661', 'path': '/dev/sde'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:00:16 user nova-compute[82184]: DEBUG nova.objects.instance [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'flavor' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:00:16 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:00:16 user nova-compute[82184]:   <source dev="/dev/sde"/>
Apr 12 02:00:16 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:00:16 user nova-compute[82184]:   <serial>f6f462d6-7d7c-4843-97c3-d0ded790997f</serial>
Apr 12 02:00:16 user nova-compute[82184]: </disk>
Apr 12 02:00:16 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:00:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:00:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:00:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No VIF found with MAC fa:16:3e:fd:07:d9, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:00:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d4416006-f402-4c20-a06a-62390eaee894 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.301s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:17 user nova-compute[82184]: INFO nova.compute.manager [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Rescuing
Apr 12 02:00:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:00:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquired lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:00:17 user nova-compute[82184]: DEBUG nova.network.neutron [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.network.neutron [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updating instance_info_cache with network_info: [{"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Releasing lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:00:18 user nova-compute[82184]: INFO nova.compute.claims [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Claim successful on node user
Apr 12 02:00:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-5466d399-823b-4cdb-b4be-ee8dbe5c3925 req-ca8c6acc-c6d7-4c6b-84fd-d717f353dcda service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-unplugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5466d399-823b-4cdb-b4be-ee8dbe5c3925 req-ca8c6acc-c6d7-4c6b-84fd-d717f353dcda service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5466d399-823b-4cdb-b4be-ee8dbe5c3925 req-ca8c6acc-c6d7-4c6b-84fd-d717f353dcda service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5466d399-823b-4cdb-b4be-ee8dbe5c3925 req-ca8c6acc-c6d7-4c6b-84fd-d717f353dcda service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-5466d399-823b-4cdb-b4be-ee8dbe5c3925 req-ca8c6acc-c6d7-4c6b-84fd-d717f353dcda service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-unplugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:18 user nova-compute[82184]: WARNING nova.compute.manager [req-5466d399-823b-4cdb-b4be-ee8dbe5c3925 req-ca8c6acc-c6d7-4c6b-84fd-d717f353dcda service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-unplugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state active and task_state rescuing.
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.network.neutron [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:00:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:00:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:00:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Instance destroyed successfully.
Apr 12 02:00:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Attempting rescue
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Instance directory exists: not creating {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 02:00:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Creating image(s)
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'trusted_certs' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.policy [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2ca4855c3e9461cb27c88469086d7d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c34bd636a2a54b249dca9ce9027ebf4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:00:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Creating image(s)
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "/opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "/opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.168s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue" returned: 0 in 0.047s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'migration_context' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Start _get_guest_xml network_info=[{"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "vif_mac": "fa:16:3e:fd:07:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'resources' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'numa_topology' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:19 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:00:19 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1373752537',display_name='tempest-ServerRescueNegativeTestJSON-server-1373752537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1373752537',id=21,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIbKc6xSzjYSTxxI8C/IAZs7b7MlyezBiUXhjYxXfwthgDrpaDZJYY7wb6RFJBJGBUJGdDeu+0PCYgm+2/EOL1dCVnyqQ1ADD+YRouh7yBs349raBu7ykBoZaVMgsZIuA==',key_name='tempest-keypair-2119544665',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:58:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-gcc6bego',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T01:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='889189da060e4b54a48ce9a013e04a3d',uuid=84b4902c-24d9-4e96-b51f-e93e913aa681,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "vif_mac": "fa:16:3e:fd:07:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "vif_mac": "fa:16:3e:fd:07:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=b1709cc0-5e25-4f89-aa42-8bc0a424adc1,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1709cc0-5e') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'pci_devices' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:00:19 user nova-compute[82184]:   <uuid>84b4902c-24d9-4e96-b51f-e93e913aa681</uuid>
Apr 12 02:00:19 user nova-compute[82184]:   <name>instance-00000015</name>
Apr 12 02:00:19 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:00:19 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:00:19 user nova-compute[82184]:   <metadata>
Apr 12 02:00:19 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:00:19 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:00:19 user nova-compute[82184]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1373752537</nova:name>
Apr 12 02:00:19 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:00:19</nova:creationTime>
Apr 12 02:00:19 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:00:19 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:00:19 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:00:19 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:00:19 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:00:19 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:00:19 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:00:19 user nova-compute[82184]:       <nova:owner>
Apr 12 02:00:19 user nova-compute[82184]:         <nova:user uuid="889189da060e4b54a48ce9a013e04a3d">tempest-ServerRescueNegativeTestJSON-502185932-project-member</nova:user>
Apr 12 02:00:19 user nova-compute[82184]:         <nova:project uuid="8fed0886b2404f41a659dc6356771e9c">tempest-ServerRescueNegativeTestJSON-502185932</nova:project>
Apr 12 02:00:19 user nova-compute[82184]:       </nova:owner>
Apr 12 02:00:19 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:00:19 user nova-compute[82184]:       <nova:ports>
Apr 12 02:00:19 user nova-compute[82184]:         <nova:port uuid="b1709cc0-5e25-4f89-aa42-8bc0a424adc1">
Apr 12 02:00:19 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 02:00:19 user nova-compute[82184]:         </nova:port>
Apr 12 02:00:19 user nova-compute[82184]:       </nova:ports>
Apr 12 02:00:19 user nova-compute[82184]:     </nova:instance>
Apr 12 02:00:19 user nova-compute[82184]:   </metadata>
Apr 12 02:00:19 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:00:19 user nova-compute[82184]:     <system>
Apr 12 02:00:19 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:00:19 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:00:19 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:00:19 user nova-compute[82184]:       <entry name="serial">84b4902c-24d9-4e96-b51f-e93e913aa681</entry>
Apr 12 02:00:19 user nova-compute[82184]:       <entry name="uuid">84b4902c-24d9-4e96-b51f-e93e913aa681</entry>
Apr 12 02:00:19 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:00:19 user nova-compute[82184]:     </system>
Apr 12 02:00:19 user nova-compute[82184]:   </sysinfo>
Apr 12 02:00:19 user nova-compute[82184]:   <os>
Apr 12 02:00:19 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:00:19 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:00:19 user nova-compute[82184]:   </os>
Apr 12 02:00:19 user nova-compute[82184]:   <features>
Apr 12 02:00:19 user nova-compute[82184]:     <acpi/>
Apr 12 02:00:19 user nova-compute[82184]:     <apic/>
Apr 12 02:00:19 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:00:19 user nova-compute[82184]:   </features>
Apr 12 02:00:19 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:00:19 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:00:19 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:00:19 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:00:19 user nova-compute[82184]:   </clock>
Apr 12 02:00:19 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:00:19 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:00:19 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:00:19 user nova-compute[82184]:   </cpu>
Apr 12 02:00:19 user nova-compute[82184]:   <devices>
Apr 12 02:00:19 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:00:19 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:00:19 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue"/>
Apr 12 02:00:19 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:00:19 user nova-compute[82184]:     </disk>
Apr 12 02:00:19 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:00:19 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:00:19 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk"/>
Apr 12 02:00:19 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 02:00:19 user nova-compute[82184]:     </disk>
Apr 12 02:00:19 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:00:19 user nova-compute[82184]:       <mac address="fa:16:3e:fd:07:d9"/>
Apr 12 02:00:19 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:00:19 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:00:19 user nova-compute[82184]:       <target dev="tapb1709cc0-5e"/>
Apr 12 02:00:19 user nova-compute[82184]:     </interface>
Apr 12 02:00:19 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:00:19 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/console.log" append="off"/>
Apr 12 02:00:19 user nova-compute[82184]:     </serial>
Apr 12 02:00:19 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:00:19 user nova-compute[82184]:     <video>
Apr 12 02:00:19 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:00:19 user nova-compute[82184]:     </video>
Apr 12 02:00:19 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:00:19 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:00:19 user nova-compute[82184]:     </rng>
Apr 12 02:00:19 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:00:19 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:00:19 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:00:19 user nova-compute[82184]:     </memballoon>
Apr 12 02:00:19 user nova-compute[82184]:   </devices>
Apr 12 02:00:19 user nova-compute[82184]: </domain>
Apr 12 02:00:19 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:00:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Instance destroyed successfully.
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk 1073741824" returned: 0 in 0.052s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] No VIF found with MAC fa:16:3e:fd:07:d9, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.157s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Cannot resize image /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'migration_context' on Instance uuid 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.network.neutron [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Successfully created port: 482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Ensure instance console log exists: /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG nova.compute.manager [req-13ed6e54-4177-42c7-ab04-54b9e02780ac req-4c39aa8b-cca4-43f7-a66a-32f1a8523680 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-13ed6e54-4177-42c7-ab04-54b9e02780ac req-4c39aa8b-cca4-43f7-a66a-32f1a8523680 service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-13ed6e54-4177-42c7-ab04-54b9e02780ac req-4c39aa8b-cca4-43f7-a66a-32f1a8523680 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-13ed6e54-4177-42c7-ab04-54b9e02780ac req-4c39aa8b-cca4-43f7-a66a-32f1a8523680 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG nova.compute.manager [req-13ed6e54-4177-42c7-ab04-54b9e02780ac req-4c39aa8b-cca4-43f7-a66a-32f1a8523680 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:20 user nova-compute[82184]: WARNING nova.compute.manager [req-13ed6e54-4177-42c7-ab04-54b9e02780ac req-4c39aa8b-cca4-43f7-a66a-32f1a8523680 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state active and task_state rescuing.
Apr 12 02:00:20 user nova-compute[82184]: DEBUG nova.network.neutron [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Successfully updated port: 482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "refresh_cache-8c37378d-17a9-42a1-abfc-00037e305d34" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquired lock "refresh_cache-8c37378d-17a9-42a1-abfc-00037e305d34" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG nova.network.neutron [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG nova.network.neutron [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG nova.compute.manager [req-8169bce2-b845-4fb8-b95b-c258c4b7060e req-a26dace5-2a36-4564-83bb-fdb33a012bde service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-changed-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG nova.compute.manager [req-8169bce2-b845-4fb8-b95b-c258c4b7060e req-a26dace5-2a36-4564-83bb-fdb33a012bde service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Refreshing instance network info cache due to event network-changed-482853e3-5a37-4420-a614-c01ba39cfb74. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:00:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8169bce2-b845-4fb8-b95b-c258c4b7060e req-a26dace5-2a36-4564-83bb-fdb33a012bde service nova] Acquiring lock "refresh_cache-8c37378d-17a9-42a1-abfc-00037e305d34" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Updating instance_info_cache with network_info: [{"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Releasing lock "refresh_cache-8c37378d-17a9-42a1-abfc-00037e305d34" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Instance network_info: |[{"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8169bce2-b845-4fb8-b95b-c258c4b7060e req-a26dace5-2a36-4564-83bb-fdb33a012bde service nova] Acquired lock "refresh_cache-8c37378d-17a9-42a1-abfc-00037e305d34" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.network.neutron [req-8169bce2-b845-4fb8-b95b-c258c4b7060e req-a26dace5-2a36-4564-83bb-fdb33a012bde service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Refreshing network info cache for port 482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Start _get_guest_xml network_info=[{"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:00:21 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:00:21 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553393100',display_name='tempest-AttachVolumeTestJSON-server-1553393100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553393100',id=24,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9PbnZpthoEPBbgAsjmQsY6RgSWKMwste0tDXW/CGuop5MpgsjfMlEApyCMQgwuzCsJ9Gr8VF6fKEHWivLB+lL3P2qNsPHCK4NwqoKfCUSZQWI/Rq+KTRt1Nfy0sVaPxw==',key_name='tempest-keypair-155530966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-d7z480cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=8c37378d-17a9-42a1-abfc-00037e305d34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1d:68,bridge_name='br-int',has_traffic_filtering=True,id=482853e3-5a37-4420-a614-c01ba39cfb74,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482853e3-5a') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.objects.instance [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:00:21 user nova-compute[82184]:   <uuid>8c37378d-17a9-42a1-abfc-00037e305d34</uuid>
Apr 12 02:00:21 user nova-compute[82184]:   <name>instance-00000018</name>
Apr 12 02:00:21 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:00:21 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:00:21 user nova-compute[82184]:   <metadata>
Apr 12 02:00:21 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:00:21 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:00:21 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeTestJSON-server-1553393100</nova:name>
Apr 12 02:00:21 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:00:21</nova:creationTime>
Apr 12 02:00:21 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:00:21 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:00:21 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:00:21 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:00:21 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:00:21 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:00:21 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:00:21 user nova-compute[82184]:       <nova:owner>
Apr 12 02:00:21 user nova-compute[82184]:         <nova:user uuid="d2ca4855c3e9461cb27c88469086d7d8">tempest-AttachVolumeTestJSON-913560355-project-member</nova:user>
Apr 12 02:00:21 user nova-compute[82184]:         <nova:project uuid="c34bd636a2a54b249dca9ce9027ebf4b">tempest-AttachVolumeTestJSON-913560355</nova:project>
Apr 12 02:00:21 user nova-compute[82184]:       </nova:owner>
Apr 12 02:00:21 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:00:21 user nova-compute[82184]:       <nova:ports>
Apr 12 02:00:21 user nova-compute[82184]:         <nova:port uuid="482853e3-5a37-4420-a614-c01ba39cfb74">
Apr 12 02:00:21 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 02:00:21 user nova-compute[82184]:         </nova:port>
Apr 12 02:00:21 user nova-compute[82184]:       </nova:ports>
Apr 12 02:00:21 user nova-compute[82184]:     </nova:instance>
Apr 12 02:00:21 user nova-compute[82184]:   </metadata>
Apr 12 02:00:21 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:00:21 user nova-compute[82184]:     <system>
Apr 12 02:00:21 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:00:21 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:00:21 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:00:21 user nova-compute[82184]:       <entry name="serial">8c37378d-17a9-42a1-abfc-00037e305d34</entry>
Apr 12 02:00:21 user nova-compute[82184]:       <entry name="uuid">8c37378d-17a9-42a1-abfc-00037e305d34</entry>
Apr 12 02:00:21 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:00:21 user nova-compute[82184]:     </system>
Apr 12 02:00:21 user nova-compute[82184]:   </sysinfo>
Apr 12 02:00:21 user nova-compute[82184]:   <os>
Apr 12 02:00:21 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:00:21 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:00:21 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:00:21 user nova-compute[82184]:   </os>
Apr 12 02:00:21 user nova-compute[82184]:   <features>
Apr 12 02:00:21 user nova-compute[82184]:     <acpi/>
Apr 12 02:00:21 user nova-compute[82184]:     <apic/>
Apr 12 02:00:21 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:00:21 user nova-compute[82184]:   </features>
Apr 12 02:00:21 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:00:21 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:00:21 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:00:21 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:00:21 user nova-compute[82184]:   </clock>
Apr 12 02:00:21 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:00:21 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:00:21 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:00:21 user nova-compute[82184]:   </cpu>
Apr 12 02:00:21 user nova-compute[82184]:   <devices>
Apr 12 02:00:21 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:00:21 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:00:21 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk"/>
Apr 12 02:00:21 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:00:21 user nova-compute[82184]:     </disk>
Apr 12 02:00:21 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:00:21 user nova-compute[82184]:       <mac address="fa:16:3e:cc:1d:68"/>
Apr 12 02:00:21 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:00:21 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:00:21 user nova-compute[82184]:       <target dev="tap482853e3-5a"/>
Apr 12 02:00:21 user nova-compute[82184]:     </interface>
Apr 12 02:00:21 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:00:21 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/console.log" append="off"/>
Apr 12 02:00:21 user nova-compute[82184]:     </serial>
Apr 12 02:00:21 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:00:21 user nova-compute[82184]:     <video>
Apr 12 02:00:21 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:00:21 user nova-compute[82184]:     </video>
Apr 12 02:00:21 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:00:21 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:00:21 user nova-compute[82184]:     </rng>
Apr 12 02:00:21 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:00:21 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:00:21 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:00:21 user nova-compute[82184]:     </memballoon>
Apr 12 02:00:21 user nova-compute[82184]:   </devices>
Apr 12 02:00:21 user nova-compute[82184]: </domain>
Apr 12 02:00:21 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553393100',display_name='tempest-AttachVolumeTestJSON-server-1553393100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553393100',id=24,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9PbnZpthoEPBbgAsjmQsY6RgSWKMwste0tDXW/CGuop5MpgsjfMlEApyCMQgwuzCsJ9Gr8VF6fKEHWivLB+lL3P2qNsPHCK4NwqoKfCUSZQWI/Rq+KTRt1Nfy0sVaPxw==',key_name='tempest-keypair-155530966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-d7z480cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:00:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=8c37378d-17a9-42a1-abfc-00037e305d34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1d:68,bridge_name='br-int',has_traffic_filtering=True,id=482853e3-5a37-4420-a614-c01ba39cfb74,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482853e3-5a') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG os_vif [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1d:68,bridge_name='br-int',has_traffic_filtering=True,id=482853e3-5a37-4420-a614-c01ba39cfb74,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482853e3-5a') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap482853e3-5a, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap482853e3-5a, col_values=(('external_ids', {'iface-id': '482853e3-5a37-4420-a614-c01ba39cfb74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:1d:68', 'vm-uuid': '8c37378d-17a9-42a1-abfc-00037e305d34'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:21 user nova-compute[82184]: INFO os_vif [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:1d:68,bridge_name='br-int',has_traffic_filtering=True,id=482853e3-5a37-4420-a614-c01ba39cfb74,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482853e3-5a')
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No VIF found with MAC fa:16:3e:cc:1d:68, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.network.neutron [req-8169bce2-b845-4fb8-b95b-c258c4b7060e req-a26dace5-2a36-4564-83bb-fdb33a012bde service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Updated VIF entry in instance network info cache for port 482853e3-5a37-4420-a614-c01ba39cfb74. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.network.neutron [req-8169bce2-b845-4fb8-b95b-c258c4b7060e req-a26dace5-2a36-4564-83bb-fdb33a012bde service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Updating instance_info_cache with network_info: [{"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8169bce2-b845-4fb8-b95b-c258c4b7060e req-a26dace5-2a36-4564-83bb-fdb33a012bde service nova] Releasing lock "refresh_cache-8c37378d-17a9-42a1-abfc-00037e305d34" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:21 user nova-compute[82184]: INFO nova.compute.manager [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Detaching volume cf91b105-163e-4c1d-a936-6939ccb3db3f
Apr 12 02:00:21 user nova-compute[82184]: INFO nova.virt.block_device [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Attempting to driver detach volume cf91b105-163e-4c1d-a936-6939ccb3db3f from mountpoint /dev/vdb
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Attempting to detach device vdb from instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:00:21 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:00:21 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:00:21 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:00:21 user nova-compute[82184]:   <serial>cf91b105-163e-4c1d-a936-6939ccb3db3f</serial>
Apr 12 02:00:21 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:00:21 user nova-compute[82184]: </disk>
Apr 12 02:00:21 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:00:21 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Successfully detached device vdb from instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 from the persistent domain config.
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:00:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:00:21 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:00:21 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:00:21 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:00:21 user nova-compute[82184]:   <serial>cf91b105-163e-4c1d-a936-6939ccb3db3f</serial>
Apr 12 02:00:21 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:00:21 user nova-compute[82184]: </disk>
Apr 12 02:00:21 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264822.3815696, 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:00:22 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Successfully detached device vdb from instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 from the live domain config.
Apr 12 02:00:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYdskMbm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:00:22 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff206b00-cc18-4af5-abf9-5b0ce4329134]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:00:22 user nova-compute[82184]: No targets found.
Apr 12 02:00:22 user nova-compute[82184]: iSNS:
Apr 12 02:00:22 user nova-compute[82184]: No targets found.
Apr 12 02:00:22 user nova-compute[82184]: STATIC:
Apr 12 02:00:22 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f
Apr 12 02:00:22 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:00:22 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:00:22 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 02:00:22 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:00:22 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:00:22 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7
Apr 12 02:00:22 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:00:22 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:00:22 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f
Apr 12 02:00:22 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:00:22 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:00:22 user nova-compute[82184]: FIRMWARE:
Apr 12 02:00:22 user nova-compute[82184]: No targets found.
Apr 12 02:00:22 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:00:22 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:00:22 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8c9b7a-6b9a-4af4-8d22-d412df5cae12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[410246d8-c032-4237-b7aa-c5e8bd699f65]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 02:00:22 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:00:22 user nova-compute[82184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:22 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:00:22 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f (non-flash)
Apr 12 02:00:22 user nova-compute[82184]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:00:22 user nova-compute[82184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:22 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:00:22 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a80eb5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a8c144-63ba-44d3-ab5c-83455c981a92]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9afcbe-7b41-4f9a-9f74-3ef9164f6f0e]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[719bdb03-f226-42bc-9293-459681eb8239]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68e0a19-27ff-4d20-8af9-4d8e514c28aa]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0178fe88-da36-43c2-b558-c70a3dbb1c0c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1547513c-52b9-4a1d-b694-f14ba6b676be]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f, portal: 172.16.0.220,3260]
Apr 12 02:00:22 user nova-compute[82184]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f, portal: 172.16.0.220,3260] successful.
Apr 12 02:00:22 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:22 user nova-compute[82184]: WARNING nova.compute.manager [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state active and task_state rescuing.
Apr 12 02:00:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:22 user nova-compute[82184]: WARNING nova.compute.manager [req-733e40e5-68df-4411-807b-bee42a148bc6 req-6dad2869-9b8f-4f33-9ab8-cd949ab2ce0c service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state active and task_state rescuing.
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf91b105-163e-4c1d-a936-6939ccb3db3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5178f6e8-84f3-4c93-8a55-4bcc9539393e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] <== disconnect_volume: return (321ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:00:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for 84b4902c-24d9-4e96-b51f-e93e913aa681 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264823.3218586, 84b4902c-24d9-4e96-b51f-e93e913aa681 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:00:23 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] VM Resumed (Lifecycle Event)
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7136b801-9c89-44da-8e64-06244f8eb689 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-f7d13973-f5db-4f68-bdee-103e1ece66db req-dbd09026-fecc-452b-a92f-b42c17e73202 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f7d13973-f5db-4f68-bdee-103e1ece66db req-dbd09026-fecc-452b-a92f-b42c17e73202 service nova] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f7d13973-f5db-4f68-bdee-103e1ece66db req-dbd09026-fecc-452b-a92f-b42c17e73202 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f7d13973-f5db-4f68-bdee-103e1ece66db req-dbd09026-fecc-452b-a92f-b42c17e73202 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-f7d13973-f5db-4f68-bdee-103e1ece66db req-dbd09026-fecc-452b-a92f-b42c17e73202 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] No waiting events found dispatching network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:23 user nova-compute[82184]: WARNING nova.compute.manager [req-f7d13973-f5db-4f68-bdee-103e1ece66db req-dbd09026-fecc-452b-a92f-b42c17e73202 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received unexpected event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 for instance with vm_state building and task_state spawning.
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:00:23 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264823.3227446, 84b4902c-24d9-4e96-b51f-e93e913aa681 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:00:23 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] VM Started (Lifecycle Event)
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'flavor' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b1c446e4-865f-44ab-bb65-8b8b7b22661b tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.972s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-572d5ce3-16e0-4095-af43-d12aa56b9a0e req-270f484e-c4e0-4d4e-8a43-a5967930e471 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-572d5ce3-16e0-4095-af43-d12aa56b9a0e req-270f484e-c4e0-4d4e-8a43-a5967930e471 service nova] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-572d5ce3-16e0-4095-af43-d12aa56b9a0e req-270f484e-c4e0-4d4e-8a43-a5967930e471 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-572d5ce3-16e0-4095-af43-d12aa56b9a0e req-270f484e-c4e0-4d4e-8a43-a5967930e471 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-572d5ce3-16e0-4095-af43-d12aa56b9a0e req-270f484e-c4e0-4d4e-8a43-a5967930e471 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] No waiting events found dispatching network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:25 user nova-compute[82184]: WARNING nova.compute.manager [req-572d5ce3-16e0-4095-af43-d12aa56b9a0e req-270f484e-c4e0-4d4e-8a43-a5967930e471 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received unexpected event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 for instance with vm_state building and task_state spawning.
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264825.5678074, 8c37378d-17a9-42a1-abfc-00037e305d34 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:00:25 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] VM Resumed (Lifecycle Event)
Apr 12 02:00:25 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Instance spawned successfully.
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:25 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264825.5680397, 8c37378d-17a9-42a1-abfc-00037e305d34 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:00:25 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] VM Started (Lifecycle Event)
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:00:25 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:00:25 user nova-compute[82184]: INFO nova.compute.manager [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Took 6.57 seconds to spawn the instance on the hypervisor.
Apr 12 02:00:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:25 user nova-compute[82184]: INFO nova.compute.manager [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Took 7.32 seconds to build instance.
Apr 12 02:00:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-836eb926-0035-42e4-8d2d-864a2b746f7a tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.518s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:26 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Port 365b7a91-793f-4aaf-af62-4e1c45d300e8 binding to destination host user is already ACTIVE {{(pid=82184) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 02:00:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:00:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:00:26 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Creating tmpfile /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/tmp_cf6ns9w to verify with other compute node that the instance is on the same shared storage. {{(pid=82184) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-80ebc3d2-214e-4cd3-a4b6-6c5c0600a1fe req-2c47946f-639d-476b-9451-6a4ea67e5240 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-80ebc3d2-214e-4cd3-a4b6-6c5c0600a1fe req-2c47946f-639d-476b-9451-6a4ea67e5240 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-80ebc3d2-214e-4cd3-a4b6-6c5c0600a1fe req-2c47946f-639d-476b-9451-6a4ea67e5240 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-80ebc3d2-214e-4cd3-a4b6-6c5c0600a1fe req-2c47946f-639d-476b-9451-6a4ea67e5240 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG nova.compute.manager [req-80ebc3d2-214e-4cd3-a4b6-6c5c0600a1fe req-2c47946f-639d-476b-9451-6a4ea67e5240 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:27 user nova-compute[82184]: WARNING nova.compute.manager [req-80ebc3d2-214e-4cd3-a4b6-6c5c0600a1fe req-2c47946f-639d-476b-9451-6a4ea67e5240 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state resized and task_state resize_reverting.
Apr 12 02:00:27 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance destroyed successfully.
Apr 12 02:00:27 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'resources' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-1476053452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:58:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:58:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG os_vif [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap365b7a91-79, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:00:27 user nova-compute[82184]: INFO os_vif [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79')
Apr 12 02:00:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:00:27 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:00:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:00:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[006810b4-68e5-4b4e-b046-0f875c6a1db8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:00:28 user nova-compute[82184]: No targets found.
Apr 12 02:00:28 user nova-compute[82184]: iSNS:
Apr 12 02:00:28 user nova-compute[82184]: No targets found.
Apr 12 02:00:28 user nova-compute[82184]: STATIC:
Apr 12 02:00:28 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f
Apr 12 02:00:28 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:00:28 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:00:28 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 02:00:28 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:00:28 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:00:28 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7
Apr 12 02:00:28 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:00:28 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:00:28 user nova-compute[82184]: FIRMWARE:
Apr 12 02:00:28 user nova-compute[82184]: No targets found.
Apr 12 02:00:28 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:00:28 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:00:28 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3df9c1f-ad60-429b-8559-6b7f5c932fca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1902e0b-59c2-4a35-a36b-a11845b9e599]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:00:28 user nova-compute[82184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:28 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:00:28 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:00:28 user nova-compute[82184]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:28 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:00:28 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a85ec0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a'): ({'sdc'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Removing single pathed devices sdc {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c52f42b-67e2-46ee-ab57-5ce1a0412a95]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d13d4a-341c-4728-9454-4884fbb92d94]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flushing IO for device /dev/sdc {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[817a1805-dfcd-4479-b205-92dd97fe256c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a51f31-b742-4a50-8d55-7df41c0776d8]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0039c907-62da-482c-868c-83aa9c0dae56]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[920cae9e-20d0-451a-9b65-03d551b6f0ab]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]
Apr 12 02:00:28 user nova-compute[82184]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.
Apr 12 02:00:28 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7327d7-7ad7-4f34-83b1-c83a0ce9890c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== disconnect_volume: return (331ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:28 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:00:28 user nova-compute[82184]: INFO nova.compute.claims [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Claim successful on node user
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.network.neutron [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:00:29 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'migration_context' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.policy [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb64ad9101674c1a92d41dfd57ca8e15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbc688a91f547c0adbf929d0f714d51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:00:29 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Creating image(s)
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "/opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "/opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.181s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk 1073741824" returned: 0 in 0.056s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-93bddc13-a4ad-430a-a470-02f30b66b716 req-03c8feb1-4253-4339-b760-4e6ceaed1b4b service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-93bddc13-a4ad-430a-a470-02f30b66b716 req-03c8feb1-4253-4339-b760-4e6ceaed1b4b service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-93bddc13-a4ad-430a-a470-02f30b66b716 req-03c8feb1-4253-4339-b760-4e6ceaed1b4b service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-93bddc13-a4ad-430a-a470-02f30b66b716 req-03c8feb1-4253-4339-b760-4e6ceaed1b4b service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-93bddc13-a4ad-430a-a470-02f30b66b716 req-03c8feb1-4253-4339-b760-4e6ceaed1b4b service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:29 user nova-compute[82184]: WARNING nova.compute.manager [req-93bddc13-a4ad-430a-a470-02f30b66b716 req-03c8feb1-4253-4339-b760-4e6ceaed1b4b service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state resized and task_state resize_reverting.
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.661s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.160s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Cannot resize image /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.objects.instance [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'migration_context' on Instance uuid cf8cad76-0623-48a0-8b77-bb94218e17a9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Ensure instance console log exists: /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:30 user nova-compute[82184]: INFO nova.compute.manager [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Swapping old allocation on dict_keys(['ab0d5e15-c70b-4898-ad6b-82542f647a5e']) held by migration 7687ad16-d1d8-435d-8780-facafbde3a7a for instance
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.network.neutron [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Successfully created port: 409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Overwriting current allocation {'allocations': {'ab0d5e15-c70b-4898-ad6b-82542f647a5e': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 29}}, 'project_id': '117589cba4a54dd581f4ec5c26b4cd2a', 'user_id': 'e8e8b9f0307b4d3fb54d89962798026b', 'consumer_generation': 1} on consumer c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "refresh_cache-c712f2db-72cb-4136-a719-56057d82fff6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG os_brick.utils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.network.neutron [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Successfully updated port: 409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4db4458-e6fe-482f-8840-28d24e5c76ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "refresh_cache-cf8cad76-0623-48a0-8b77-bb94218e17a9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquired lock "refresh_cache-cf8cad76-0623-48a0-8b77-bb94218e17a9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.network.neutron [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f28135-6063-46e5-bd9d-1d5c162adb38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-db6759bf-d861-4068-8647-1bb122f1adb6 req-d6c6b01d-2681-4173-a179-9f8ffa0e9d7d service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Received event network-changed-409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-db6759bf-d861-4068-8647-1bb122f1adb6 req-d6c6b01d-2681-4173-a179-9f8ffa0e9d7d service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Refreshing instance network info cache due to event network-changed-409d9b69-5424-4507-8052-591629d7c44c. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-db6759bf-d861-4068-8647-1bb122f1adb6 req-d6c6b01d-2681-4173-a179-9f8ffa0e9d7d service nova] Acquiring lock "refresh_cache-cf8cad76-0623-48a0-8b77-bb94218e17a9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e884915-a679-4e93-b58e-a427747143ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98c89e7-f8f4-4dc0-8249-d00c5547ae63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.network.neutron [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:00:31 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:00:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44528aa-5255-418e-9c56-a462190cb93e]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG os_brick.utils [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.network.neutron [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Updating instance_info_cache with network_info: [{"id": "409d9b69-5424-4507-8052-591629d7c44c", "address": "fa:16:3e:9f:b3:60", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409d9b69-54", "ovs_interfaceid": "409d9b69-5424-4507-8052-591629d7c44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Releasing lock "refresh_cache-cf8cad76-0623-48a0-8b77-bb94218e17a9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Instance network_info: |[{"id": "409d9b69-5424-4507-8052-591629d7c44c", "address": "fa:16:3e:9f:b3:60", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409d9b69-54", "ovs_interfaceid": "409d9b69-5424-4507-8052-591629d7c44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-db6759bf-d861-4068-8647-1bb122f1adb6 req-d6c6b01d-2681-4173-a179-9f8ffa0e9d7d service nova] Acquired lock "refresh_cache-cf8cad76-0623-48a0-8b77-bb94218e17a9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.network.neutron [req-db6759bf-d861-4068-8647-1bb122f1adb6 req-d6c6b01d-2681-4173-a179-9f8ffa0e9d7d service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Refreshing network info cache for port 409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Start _get_guest_xml network_info=[{"id": "409d9b69-5424-4507-8052-591629d7c44c", "address": "fa:16:3e:9f:b3:60", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409d9b69-54", "ovs_interfaceid": "409d9b69-5424-4507-8052-591629d7c44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:00:31 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:00:31 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1013259307',display_name='tempest-VolumesSnapshotTestJSON-instance-1013259307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1013259307',id=25,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dbc688a91f547c0adbf929d0f714d51',ramdisk_id='',reservation_id='r-qyza2gae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1019440197',owner_user_name='tempest-VolumesSnapshotTestJSON-1019440197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:00:29Z,user_data=None,user_id='cb64ad9101674c1a92d41dfd57ca8e15',uuid=cf8cad76-0623-48a0-8b77-bb94218e17a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "409d9b69-5424-4507-8052-591629d7c44c", "address": "fa:16:3e:9f:b3:60", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409d9b69-54", "ovs_interfaceid": "409d9b69-5424-4507-8052-591629d7c44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converting VIF {"id": "409d9b69-5424-4507-8052-591629d7c44c", "address": "fa:16:3e:9f:b3:60", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409d9b69-54", "ovs_interfaceid": "409d9b69-5424-4507-8052-591629d7c44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b3:60,bridge_name='br-int',has_traffic_filtering=True,id=409d9b69-5424-4507-8052-591629d7c44c,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409d9b69-54') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.objects.instance [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'pci_devices' on Instance uuid cf8cad76-0623-48a0-8b77-bb94218e17a9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:00:31 user nova-compute[82184]:   <uuid>cf8cad76-0623-48a0-8b77-bb94218e17a9</uuid>
Apr 12 02:00:31 user nova-compute[82184]:   <name>instance-00000019</name>
Apr 12 02:00:31 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:00:31 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:00:31 user nova-compute[82184]:   <metadata>
Apr 12 02:00:31 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:00:31 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:00:31 user nova-compute[82184]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1013259307</nova:name>
Apr 12 02:00:31 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:00:31</nova:creationTime>
Apr 12 02:00:31 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:00:31 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:00:31 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:00:31 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:00:31 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:00:31 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:00:31 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:00:31 user nova-compute[82184]:       <nova:owner>
Apr 12 02:00:31 user nova-compute[82184]:         <nova:user uuid="cb64ad9101674c1a92d41dfd57ca8e15">tempest-VolumesSnapshotTestJSON-1019440197-project-member</nova:user>
Apr 12 02:00:31 user nova-compute[82184]:         <nova:project uuid="1dbc688a91f547c0adbf929d0f714d51">tempest-VolumesSnapshotTestJSON-1019440197</nova:project>
Apr 12 02:00:31 user nova-compute[82184]:       </nova:owner>
Apr 12 02:00:31 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:00:31 user nova-compute[82184]:       <nova:ports>
Apr 12 02:00:31 user nova-compute[82184]:         <nova:port uuid="409d9b69-5424-4507-8052-591629d7c44c">
Apr 12 02:00:31 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 02:00:31 user nova-compute[82184]:         </nova:port>
Apr 12 02:00:31 user nova-compute[82184]:       </nova:ports>
Apr 12 02:00:31 user nova-compute[82184]:     </nova:instance>
Apr 12 02:00:31 user nova-compute[82184]:   </metadata>
Apr 12 02:00:31 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:00:31 user nova-compute[82184]:     <system>
Apr 12 02:00:31 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:00:31 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:00:31 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:00:31 user nova-compute[82184]:       <entry name="serial">cf8cad76-0623-48a0-8b77-bb94218e17a9</entry>
Apr 12 02:00:31 user nova-compute[82184]:       <entry name="uuid">cf8cad76-0623-48a0-8b77-bb94218e17a9</entry>
Apr 12 02:00:31 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:00:31 user nova-compute[82184]:     </system>
Apr 12 02:00:31 user nova-compute[82184]:   </sysinfo>
Apr 12 02:00:31 user nova-compute[82184]:   <os>
Apr 12 02:00:31 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:00:31 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:00:31 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:00:31 user nova-compute[82184]:   </os>
Apr 12 02:00:31 user nova-compute[82184]:   <features>
Apr 12 02:00:31 user nova-compute[82184]:     <acpi/>
Apr 12 02:00:31 user nova-compute[82184]:     <apic/>
Apr 12 02:00:31 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:00:31 user nova-compute[82184]:   </features>
Apr 12 02:00:31 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:00:31 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:00:31 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:00:31 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:00:31 user nova-compute[82184]:   </clock>
Apr 12 02:00:31 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:00:31 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:00:31 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:00:31 user nova-compute[82184]:   </cpu>
Apr 12 02:00:31 user nova-compute[82184]:   <devices>
Apr 12 02:00:31 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:00:31 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:00:31 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk"/>
Apr 12 02:00:31 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:00:31 user nova-compute[82184]:     </disk>
Apr 12 02:00:31 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:00:31 user nova-compute[82184]:       <mac address="fa:16:3e:9f:b3:60"/>
Apr 12 02:00:31 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:00:31 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:00:31 user nova-compute[82184]:       <target dev="tap409d9b69-54"/>
Apr 12 02:00:31 user nova-compute[82184]:     </interface>
Apr 12 02:00:31 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:00:31 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/console.log" append="off"/>
Apr 12 02:00:31 user nova-compute[82184]:     </serial>
Apr 12 02:00:31 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:00:31 user nova-compute[82184]:     <video>
Apr 12 02:00:31 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:00:31 user nova-compute[82184]:     </video>
Apr 12 02:00:31 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:00:31 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:00:31 user nova-compute[82184]:     </rng>
Apr 12 02:00:31 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:00:31 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:00:31 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:00:31 user nova-compute[82184]:     </memballoon>
Apr 12 02:00:31 user nova-compute[82184]:   </devices>
Apr 12 02:00:31 user nova-compute[82184]: </domain>
Apr 12 02:00:31 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1013259307',display_name='tempest-VolumesSnapshotTestJSON-instance-1013259307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1013259307',id=25,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1dbc688a91f547c0adbf929d0f714d51',ramdisk_id='',reservation_id='r-qyza2gae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1019440197',owner_user_name='tempest-VolumesSnapshotTestJSON-1019440197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:00:29Z,user_data=None,user_id='cb64ad9101674c1a92d41dfd57ca8e15',uuid=cf8cad76-0623-48a0-8b77-bb94218e17a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "409d9b69-5424-4507-8052-591629d7c44c", "address": "fa:16:3e:9f:b3:60", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409d9b69-54", "ovs_interfaceid": "409d9b69-5424-4507-8052-591629d7c44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converting VIF {"id": "409d9b69-5424-4507-8052-591629d7c44c", "address": "fa:16:3e:9f:b3:60", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409d9b69-54", "ovs_interfaceid": "409d9b69-5424-4507-8052-591629d7c44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b3:60,bridge_name='br-int',has_traffic_filtering=True,id=409d9b69-5424-4507-8052-591629d7c44c,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409d9b69-54') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG os_vif [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b3:60,bridge_name='br-int',has_traffic_filtering=True,id=409d9b69-5424-4507-8052-591629d7c44c,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409d9b69-54') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap409d9b69-54, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap409d9b69-54, col_values=(('external_ids', {'iface-id': '409d9b69-5424-4507-8052-591629d7c44c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:b3:60', 'vm-uuid': 'cf8cad76-0623-48a0-8b77-bb94218e17a9'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:31 user nova-compute[82184]: INFO os_vif [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b3:60,bridge_name='br-int',has_traffic_filtering=True,id=409d9b69-5424-4507-8052-591629d7c44c,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409d9b69-54')
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] No VIF found with MAC fa:16:3e:9f:b3:60, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.network.neutron [req-db6759bf-d861-4068-8647-1bb122f1adb6 req-d6c6b01d-2681-4173-a179-9f8ffa0e9d7d service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Updated VIF entry in instance network info cache for port 409d9b69-5424-4507-8052-591629d7c44c. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG nova.network.neutron [req-db6759bf-d861-4068-8647-1bb122f1adb6 req-d6c6b01d-2681-4173-a179-9f8ffa0e9d7d service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Updating instance_info_cache with network_info: [{"id": "409d9b69-5424-4507-8052-591629d7c44c", "address": "fa:16:3e:9f:b3:60", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409d9b69-54", "ovs_interfaceid": "409d9b69-5424-4507-8052-591629d7c44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:00:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-db6759bf-d861-4068-8647-1bb122f1adb6 req-d6c6b01d-2681-4173-a179-9f8ffa0e9d7d service nova] Releasing lock "refresh_cache-cf8cad76-0623-48a0-8b77-bb94218e17a9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:00:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-3f94dfd6-27bd-4b83-b75e-2e9fb5b32f66 req-633b6c83-ee2c-45e7-8204-a3fd566b2489 service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Received event network-vif-plugged-409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3f94dfd6-27bd-4b83-b75e-2e9fb5b32f66 req-633b6c83-ee2c-45e7-8204-a3fd566b2489 service nova] Acquiring lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3f94dfd6-27bd-4b83-b75e-2e9fb5b32f66 req-633b6c83-ee2c-45e7-8204-a3fd566b2489 service nova] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3f94dfd6-27bd-4b83-b75e-2e9fb5b32f66 req-633b6c83-ee2c-45e7-8204-a3fd566b2489 service nova] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-3f94dfd6-27bd-4b83-b75e-2e9fb5b32f66 req-633b6c83-ee2c-45e7-8204-a3fd566b2489 service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] No waiting events found dispatching network-vif-plugged-409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:33 user nova-compute[82184]: WARNING nova.compute.manager [req-3f94dfd6-27bd-4b83-b75e-2e9fb5b32f66 req-633b6c83-ee2c-45e7-8204-a3fd566b2489 service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Received unexpected event network-vif-plugged-409d9b69-5424-4507-8052-591629d7c44c for instance with vm_state building and task_state spawning.
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264835.031223, cf8cad76-0623-48a0-8b77-bb94218e17a9 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:00:35 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] VM Resumed (Lifecycle Event)
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:00:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Instance spawned successfully.
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:00:35 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264835.0421598, cf8cad76-0623-48a0-8b77-bb94218e17a9 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:00:35 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] VM Started (Lifecycle Event)
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:00:35 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-3e01c401-ea49-4284-a043-4283b9ca34fa req-73833f93-a678-42bb-9631-9c11bda83a34 service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Received event network-vif-plugged-409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3e01c401-ea49-4284-a043-4283b9ca34fa req-73833f93-a678-42bb-9631-9c11bda83a34 service nova] Acquiring lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3e01c401-ea49-4284-a043-4283b9ca34fa req-73833f93-a678-42bb-9631-9c11bda83a34 service nova] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3e01c401-ea49-4284-a043-4283b9ca34fa req-73833f93-a678-42bb-9631-9c11bda83a34 service nova] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-3e01c401-ea49-4284-a043-4283b9ca34fa req-73833f93-a678-42bb-9631-9c11bda83a34 service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] No waiting events found dispatching network-vif-plugged-409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:35 user nova-compute[82184]: WARNING nova.compute.manager [req-3e01c401-ea49-4284-a043-4283b9ca34fa req-73833f93-a678-42bb-9631-9c11bda83a34 service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Received unexpected event network-vif-plugged-409d9b69-5424-4507-8052-591629d7c44c for instance with vm_state building and task_state spawning.
Apr 12 02:00:35 user nova-compute[82184]: INFO nova.compute.manager [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Took 5.75 seconds to spawn the instance on the hypervisor.
Apr 12 02:00:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:35 user nova-compute[82184]: INFO nova.compute.manager [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Took 6.64 seconds to build instance.
Apr 12 02:00:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8a7962f-0e2d-4327-bd61-9a31e25c89bd tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.731s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Starting finish_revert_migration {{(pid=82184) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Start _get_guest_xml network_info=[{"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': '1eb2402d-7313-4535-af5c-35348e5308c0', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c712f2db-72cb-4136-a719-56057d82fff6', 'attached_at': '2023-04-12T02:00:36.000000', 'detached_at': '', 'volume_id': '7c40d13a-f773-494b-be5c-b559dfc5686a', 'serial': '7c40d13a-f773-494b-be5c-b559dfc5686a'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:00:36 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:00:36 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'vcpu_model' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:00:36 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:00:36 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:00:36 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2f7bc5-31aa-4c89-bdfe-b08d54df06a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:00:36 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9852c6cd-723a-4848-8e80-bcf9e4f4888d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a] added
Apr 12 02:00:36 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c21f43-642d-4a6a-bda3-f3f9d162f3ea]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f18eda1-d1ce-4153-bdb6-cfc41ff14af7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAGdQMby {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAGdQMby" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54769bf4-ecbb-4fc1-ba0c-7efdb1f5ab25]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAGdQMby'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec7c3b1-dca9-4b2c-9d1e-5630bddb6ce1]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2482f54-587f-4cf3-b9ca-f69a35060bab]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:36 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:00:36 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:36 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:00:36 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[95caa537-e0a7-4e8b-a69b-1889bf60ec42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]
Apr 12 02:00:36 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.
Apr 12 02:00:36 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed0668d-d6f3-4f7b-95ed-eca5d89e3efd]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded413b8-3018-41fc-a349-a209e28027bf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:36 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:00:36 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:00:36 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:00:36 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:00:36 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:00:36 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37895dcb-26be-4c03-a8d2-8ed3ba987e80]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:00:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23136393463663966', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136393463663966', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-1476053452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:58:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:00:37 user nova-compute[82184]:   <uuid>c712f2db-72cb-4136-a719-56057d82fff6</uuid>
Apr 12 02:00:37 user nova-compute[82184]:   <name>instance-00000002</name>
Apr 12 02:00:37 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:00:37 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:00:37 user nova-compute[82184]:   <metadata>
Apr 12 02:00:37 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:00:37 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:00:37 user nova-compute[82184]:       <nova:name>tempest-ServerActionsTestJSON-server-1476053452</nova:name>
Apr 12 02:00:37 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:00:36</nova:creationTime>
Apr 12 02:00:37 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:00:37 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:00:37 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:00:37 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:00:37 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:00:37 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:00:37 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:00:37 user nova-compute[82184]:       <nova:owner>
Apr 12 02:00:37 user nova-compute[82184]:         <nova:user uuid="e8e8b9f0307b4d3fb54d89962798026b">tempest-ServerActionsTestJSON-1409832124-project-member</nova:user>
Apr 12 02:00:37 user nova-compute[82184]:         <nova:project uuid="117589cba4a54dd581f4ec5c26b4cd2a">tempest-ServerActionsTestJSON-1409832124</nova:project>
Apr 12 02:00:37 user nova-compute[82184]:       </nova:owner>
Apr 12 02:00:37 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:00:37 user nova-compute[82184]:       <nova:ports>
Apr 12 02:00:37 user nova-compute[82184]:         <nova:port uuid="365b7a91-793f-4aaf-af62-4e1c45d300e8">
Apr 12 02:00:37 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 02:00:37 user nova-compute[82184]:         </nova:port>
Apr 12 02:00:37 user nova-compute[82184]:       </nova:ports>
Apr 12 02:00:37 user nova-compute[82184]:     </nova:instance>
Apr 12 02:00:37 user nova-compute[82184]:   </metadata>
Apr 12 02:00:37 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:00:37 user nova-compute[82184]:     <system>
Apr 12 02:00:37 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:00:37 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:00:37 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:00:37 user nova-compute[82184]:       <entry name="serial">c712f2db-72cb-4136-a719-56057d82fff6</entry>
Apr 12 02:00:37 user nova-compute[82184]:       <entry name="uuid">c712f2db-72cb-4136-a719-56057d82fff6</entry>
Apr 12 02:00:37 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:00:37 user nova-compute[82184]:     </system>
Apr 12 02:00:37 user nova-compute[82184]:   </sysinfo>
Apr 12 02:00:37 user nova-compute[82184]:   <os>
Apr 12 02:00:37 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:00:37 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:00:37 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:00:37 user nova-compute[82184]:   </os>
Apr 12 02:00:37 user nova-compute[82184]:   <features>
Apr 12 02:00:37 user nova-compute[82184]:     <acpi/>
Apr 12 02:00:37 user nova-compute[82184]:     <apic/>
Apr 12 02:00:37 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:00:37 user nova-compute[82184]:   </features>
Apr 12 02:00:37 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:00:37 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:00:37 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:00:37 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:00:37 user nova-compute[82184]:   </clock>
Apr 12 02:00:37 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:00:37 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:00:37 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:00:37 user nova-compute[82184]:   </cpu>
Apr 12 02:00:37 user nova-compute[82184]:   <devices>
Apr 12 02:00:37 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:00:37 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:00:37 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk"/>
Apr 12 02:00:37 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:00:37 user nova-compute[82184]:     </disk>
Apr 12 02:00:37 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:00:37 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:00:37 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 02:00:37 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 02:00:37 user nova-compute[82184]:       <serial>7c40d13a-f773-494b-be5c-b559dfc5686a</serial>
Apr 12 02:00:37 user nova-compute[82184]:     </disk>
Apr 12 02:00:37 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:00:37 user nova-compute[82184]:       <mac address="fa:16:3e:f9:ed:df"/>
Apr 12 02:00:37 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:00:37 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:00:37 user nova-compute[82184]:       <target dev="tap365b7a91-79"/>
Apr 12 02:00:37 user nova-compute[82184]:     </interface>
Apr 12 02:00:37 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:00:37 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/console.log" append="off"/>
Apr 12 02:00:37 user nova-compute[82184]:     </serial>
Apr 12 02:00:37 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:00:37 user nova-compute[82184]:     <video>
Apr 12 02:00:37 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:00:37 user nova-compute[82184]:     </video>
Apr 12 02:00:37 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:00:37 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:00:37 user nova-compute[82184]:     </rng>
Apr 12 02:00:37 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:00:37 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:00:37 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:00:37 user nova-compute[82184]:     </memballoon>
Apr 12 02:00:37 user nova-compute[82184]:   </devices>
Apr 12 02:00:37 user nova-compute[82184]: </domain>
Apr 12 02:00:37 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-1476053452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:58:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG os_vif [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap365b7a91-79, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap365b7a91-79, col_values=(('external_ids', {'iface-id': '365b7a91-793f-4aaf-af62-4e1c45d300e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:ed:df', 'vm-uuid': 'c712f2db-72cb-4136-a719-56057d82fff6'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:00:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:37 user nova-compute[82184]: INFO os_vif [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79')
Apr 12 02:00:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-c516c220-4546-45cc-80cc-0b5e94d3b0fc req-5c69abdd-b889-446c-89f2-2881b7df3a27 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c516c220-4546-45cc-80cc-0b5e94d3b0fc req-5c69abdd-b889-446c-89f2-2881b7df3a27 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c516c220-4546-45cc-80cc-0b5e94d3b0fc req-5c69abdd-b889-446c-89f2-2881b7df3a27 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c516c220-4546-45cc-80cc-0b5e94d3b0fc req-5c69abdd-b889-446c-89f2-2881b7df3a27 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-c516c220-4546-45cc-80cc-0b5e94d3b0fc req-5c69abdd-b889-446c-89f2-2881b7df3a27 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:39 user nova-compute[82184]: WARNING nova.compute.manager [req-c516c220-4546-45cc-80cc-0b5e94d3b0fc req-5c69abdd-b889-446c-89f2-2881b7df3a27 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state resized and task_state resize_reverting.
Apr 12 02:00:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for c712f2db-72cb-4136-a719-56057d82fff6 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264841.0155673, c712f2db-72cb-4136-a719-56057d82fff6 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:00:41 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] VM Resumed (Lifecycle Event)
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:00:41 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance running successfully.
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] finish_revert_migration finished successfully. {{(pid=82184) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:00:41 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264841.016705, c712f2db-72cb-4136-a719-56057d82fff6 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:00:41 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] VM Started (Lifecycle Event)
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:00:41 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-2cbffb68-c597-4c78-aa3a-c8cd4a5636c3 req-76bbecf9-8211-4425-b927-7122ff2a2e6d service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:00:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2cbffb68-c597-4c78-aa3a-c8cd4a5636c3 req-76bbecf9-8211-4425-b927-7122ff2a2e6d service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2cbffb68-c597-4c78-aa3a-c8cd4a5636c3 req-76bbecf9-8211-4425-b927-7122ff2a2e6d service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2cbffb68-c597-4c78-aa3a-c8cd4a5636c3 req-76bbecf9-8211-4425-b927-7122ff2a2e6d service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-2cbffb68-c597-4c78-aa3a-c8cd4a5636c3 req-76bbecf9-8211-4425-b927-7122ff2a2e6d service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:00:41 user nova-compute[82184]: WARNING nova.compute.manager [req-2cbffb68-c597-4c78-aa3a-c8cd4a5636c3 req-76bbecf9-8211-4425-b927-7122ff2a2e6d service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state resized and task_state resize_reverting.
Apr 12 02:00:41 user nova-compute[82184]: INFO nova.compute.manager [None req-4a9d087a-5399-4cfe-b282-d8f0259fd86c tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance to original state: 'active'
Apr 12 02:00:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:00:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:00:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:00:47 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating instance_info_cache with network_info: [{"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:00:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:00:52 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:00:52 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=7650MB free_disk=26.33580780029297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 84b4902c-24d9-4e96-b51f-e93e913aa681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance b8c39c58-73b3-4574-9fcf-0c5901a81aa0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 8c37378d-17a9-42a1-abfc-00037e305d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cf8cad76-0623-48a0-8b77-bb94218e17a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:00:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:00:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:00:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:14 user nova-compute[82184]: INFO nova.compute.manager [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Terminating instance
Apr 12 02:01:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-ea2ff721-7313-47a1-baff-4b19996e7ee7 req-1593a3e6-5636-4cae-8c5b-42b63d09f04f service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ea2ff721-7313-47a1-baff-4b19996e7ee7 req-1593a3e6-5636-4cae-8c5b-42b63d09f04f service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ea2ff721-7313-47a1-baff-4b19996e7ee7 req-1593a3e6-5636-4cae-8c5b-42b63d09f04f service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ea2ff721-7313-47a1-baff-4b19996e7ee7 req-1593a3e6-5636-4cae-8c5b-42b63d09f04f service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-ea2ff721-7313-47a1-baff-4b19996e7ee7 req-1593a3e6-5636-4cae-8c5b-42b63d09f04f service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:01:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-ea2ff721-7313-47a1-baff-4b19996e7ee7 req-1593a3e6-5636-4cae-8c5b-42b63d09f04f service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-unplugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:01:15 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Instance destroyed successfully.
Apr 12 02:01:15 user nova-compute[82184]: DEBUG nova.objects.instance [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lazy-loading 'resources' on Instance uuid 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:01:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1700354406',display_name='tempest-ServerStableDeviceRescueTest-server-1700354406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1700354406',id=16,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI/RFUfuZXI6dJ1hjD1JW2D0k8xZh+epQO+5dsrL15C9zRJbRnL07EyJ7CDIspWuf9JFtZqO5PUPIpDarEwCZLJxygT+Ba5rtS558RsdJ4Kzf5y9GMjIllAHF5H0rE0pA==',key_name='tempest-keypair-682814124',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:58:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdf7e36a5e4b44f690f875999b4b101a',ramdisk_id='',reservation_id='r-00qom6go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1741311402',owner_user_name='tempest-ServerStableDeviceRescueTest-1741311402-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:59:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6c9d8100d504d1c8437b627f5564e33',uuid=0d49cd12-9b4d-4a93-ad5f-bbf0536d5959,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:01:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Converting VIF {"id": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "address": "fa:16:3e:f4:60:ca", "network": {"id": "849f67cf-2fe1-4792-ac08-a770ab4435c3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1064086071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdf7e36a5e4b44f690f875999b4b101a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c37f41-cb", "ovs_interfaceid": "77c37f41-cbd9-4b96-a5e7-103d187fce32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:01:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:60:ca,bridge_name='br-int',has_traffic_filtering=True,id=77c37f41-cbd9-4b96-a5e7-103d187fce32,network=Network(849f67cf-2fe1-4792-ac08-a770ab4435c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c37f41-cb') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:01:15 user nova-compute[82184]: DEBUG os_vif [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:60:ca,bridge_name='br-int',has_traffic_filtering=True,id=77c37f41-cbd9-4b96-a5e7-103d187fce32,network=Network(849f67cf-2fe1-4792-ac08-a770ab4435c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c37f41-cb') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:01:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77c37f41-cb, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:01:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:01:15 user nova-compute[82184]: INFO os_vif [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:60:ca,bridge_name='br-int',has_traffic_filtering=True,id=77c37f41-cbd9-4b96-a5e7-103d187fce32,network=Network(849f67cf-2fe1-4792-ac08-a770ab4435c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c37f41-cb')
Apr 12 02:01:15 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Deleting instance files /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959_del
Apr 12 02:01:15 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Deletion of /opt/stack/data/nova/instances/0d49cd12-9b4d-4a93-ad5f-bbf0536d5959_del complete
Apr 12 02:01:15 user nova-compute[82184]: INFO nova.compute.manager [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 02:01:15 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:01:15 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:01:15 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:01:16 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Took 1.27 seconds to deallocate network for instance.
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-7393785e-36db-430f-b956-7884e0f6cd2d req-60ffe742-d0c3-44ff-8f9f-5baffbdf9a06 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-deleted-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:16 user nova-compute[82184]: INFO nova.compute.manager [req-7393785e-36db-430f-b956-7884e0f6cd2d req-60ffe742-d0c3-44ff-8f9f-5baffbdf9a06 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Neutron deleted interface 77c37f41-cbd9-4b96-a5e7-103d187fce32; detaching it from the instance and deleting it from the info cache
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.network.neutron [req-7393785e-36db-430f-b956-7884e0f6cd2d req-60ffe742-d0c3-44ff-8f9f-5baffbdf9a06 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-7393785e-36db-430f-b956-7884e0f6cd2d req-60ffe742-d0c3-44ff-8f9f-5baffbdf9a06 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Detach interface failed, port_id=77c37f41-cbd9-4b96-a5e7-103d187fce32, reason: Instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-9bf430e6-785d-4ae0-8d2f-c6f083568c65 req-b94bd72c-76ba-494a-8bd7-e54685d577e5 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9bf430e6-785d-4ae0-8d2f-c6f083568c65 req-b94bd72c-76ba-494a-8bd7-e54685d577e5 service nova] Acquiring lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9bf430e6-785d-4ae0-8d2f-c6f083568c65 req-b94bd72c-76ba-494a-8bd7-e54685d577e5 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9bf430e6-785d-4ae0-8d2f-c6f083568c65 req-b94bd72c-76ba-494a-8bd7-e54685d577e5 service nova] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-9bf430e6-785d-4ae0-8d2f-c6f083568c65 req-b94bd72c-76ba-494a-8bd7-e54685d577e5 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] No waiting events found dispatching network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:01:16 user nova-compute[82184]: WARNING nova.compute.manager [req-9bf430e6-785d-4ae0-8d2f-c6f083568c65 req-b94bd72c-76ba-494a-8bd7-e54685d577e5 service nova] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Received unexpected event network-vif-plugged-77c37f41-cbd9-4b96-a5e7-103d187fce32 for instance with vm_state deleted and task_state None.
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:01:16 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:01:17 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:01:17 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:01:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:17 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Deleted allocations for instance 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959
Apr 12 02:01:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-946a9f96-d822-47b9-9ae8-dc34206664d6 tempest-ServerStableDeviceRescueTest-1741311402 tempest-ServerStableDeviceRescueTest-1741311402-project-member] Lock "0d49cd12-9b4d-4a93-ad5f-bbf0536d5959" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.794s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:30 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264875.333611, 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:01:30 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] VM Stopped (Lifecycle Event)
Apr 12 02:01:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1a90cb3a-9494-432e-8d4c-1cc2a9e041f0 None None] [instance: 0d49cd12-9b4d-4a93-ad5f-bbf0536d5959] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:01:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-565041e2-6999-4f32-a1e6-87097cbee095 req-1fd9e6a6-571d-4b41-95e6-87fd3d233400 service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received event network-changed-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-565041e2-6999-4f32-a1e6-87097cbee095 req-1fd9e6a6-571d-4b41-95e6-87fd3d233400 service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Refreshing instance network info cache due to event network-changed-bc0f00ae-1855-439a-a945-9cc72e70fcc4. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:01:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-565041e2-6999-4f32-a1e6-87097cbee095 req-1fd9e6a6-571d-4b41-95e6-87fd3d233400 service nova] Acquiring lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:01:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-565041e2-6999-4f32-a1e6-87097cbee095 req-1fd9e6a6-571d-4b41-95e6-87fd3d233400 service nova] Acquired lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:01:30 user nova-compute[82184]: DEBUG nova.network.neutron [req-565041e2-6999-4f32-a1e6-87097cbee095 req-1fd9e6a6-571d-4b41-95e6-87fd3d233400 service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Refreshing network info cache for port bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:01:31 user nova-compute[82184]: DEBUG nova.network.neutron [req-565041e2-6999-4f32-a1e6-87097cbee095 req-1fd9e6a6-571d-4b41-95e6-87fd3d233400 service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Updated VIF entry in instance network info cache for port bc0f00ae-1855-439a-a945-9cc72e70fcc4. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:01:31 user nova-compute[82184]: DEBUG nova.network.neutron [req-565041e2-6999-4f32-a1e6-87097cbee095 req-1fd9e6a6-571d-4b41-95e6-87fd3d233400 service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Updating instance_info_cache with network_info: [{"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:01:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-565041e2-6999-4f32-a1e6-87097cbee095 req-1fd9e6a6-571d-4b41-95e6-87fd3d233400 service nova] Releasing lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:01:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'flavor' on Instance uuid 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:33 user nova-compute[82184]: INFO nova.compute.manager [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Attaching volume 7353ae0d-d613-4966-adae-68aa36212f56 to /dev/vdb
Apr 12 02:01:33 user nova-compute[82184]: DEBUG os_brick.utils [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb27ee03-c0f5-4f88-894f-662c5b4ca391]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f82a6-a299-4648-82f6-59d7ec9c27aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde0761-33aa-4a21-b503-f4f9063b8df3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2488c046-823f-43cb-b35b-c39245eaf128]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:01:33 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:01:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0a795a-6342-468f-be09-f78815098c6b]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG os_brick.utils [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:01:33 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Updating existing volume attachment record: 191b0a46-e5d2-4200-8b4c-cf35d96a5e03 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:01:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-91cbec28-1835-420e-af66-cfc503209003 req-d2dfd55a-a951-4751-a46f-e401a42673b3 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-changed-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-91cbec28-1835-420e-af66-cfc503209003 req-d2dfd55a-a951-4751-a46f-e401a42673b3 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Refreshing instance network info cache due to event network-changed-b64bd49d-20d0-4f9d-b07c-078a55b0542f. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-91cbec28-1835-420e-af66-cfc503209003 req-d2dfd55a-a951-4751-a46f-e401a42673b3 service nova] Acquiring lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-91cbec28-1835-420e-af66-cfc503209003 req-d2dfd55a-a951-4751-a46f-e401a42673b3 service nova] Acquired lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG nova.network.neutron [req-91cbec28-1835-420e-af66-cfc503209003 req-d2dfd55a-a951-4751-a46f-e401a42673b3 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Refreshing network info cache for port b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:35 user nova-compute[82184]: INFO nova.compute.manager [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Shelve offloading
Apr 12 02:01:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG nova.network.neutron [req-91cbec28-1835-420e-af66-cfc503209003 req-d2dfd55a-a951-4751-a46f-e401a42673b3 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updated VIF entry in instance network info cache for port b64bd49d-20d0-4f9d-b07c-078a55b0542f. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG nova.network.neutron [req-91cbec28-1835-420e-af66-cfc503209003 req-d2dfd55a-a951-4751-a46f-e401a42673b3 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating instance_info_cache with network_info: [{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-91cbec28-1835-420e-af66-cfc503209003 req-d2dfd55a-a951-4751-a46f-e401a42673b3 service nova] Releasing lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-26157423-e25d-47e2-ae43-b0ab8a294882 req-9d761290-70f1-4a7a-8a81-6959bc3f181c service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-vif-unplugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-26157423-e25d-47e2-ae43-b0ab8a294882 req-9d761290-70f1-4a7a-8a81-6959bc3f181c service nova] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-26157423-e25d-47e2-ae43-b0ab8a294882 req-9d761290-70f1-4a7a-8a81-6959bc3f181c service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-26157423-e25d-47e2-ae43-b0ab8a294882 req-9d761290-70f1-4a7a-8a81-6959bc3f181c service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-26157423-e25d-47e2-ae43-b0ab8a294882 req-9d761290-70f1-4a7a-8a81-6959bc3f181c service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] No waiting events found dispatching network-vif-unplugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:01:35 user nova-compute[82184]: WARNING nova.compute.manager [req-26157423-e25d-47e2-ae43-b0ab8a294882 req-9d761290-70f1-4a7a-8a81-6959bc3f181c service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received unexpected event network-vif-unplugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f for instance with vm_state active and task_state shelving.
Apr 12 02:01:36 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Instance destroyed successfully.
Apr 12 02:01:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:01:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:01:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquired lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:01:36 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:01:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:36 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating instance_info_cache with network_info: [{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:01:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Releasing lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:01:37 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Instance destroyed successfully.
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.objects.instance [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lazy-loading 'resources' on Instance uuid b8c39c58-73b3-4574-9fcf-0c5901a81aa0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-662581423',display_name='tempest-TestShelveInstance-server-662581423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-662581423',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzJEkyxrgGdFi9xp4HEHo6h+HMI/sf0D1BEcLp1PlBC0aEIXZkpEAZB7dj1l2oKNIXETzcME23LJ7KETYvsoSN/f9VetiXUt+tFF8xxyxwD7zg/09NP8sJhNpL272IgEg==',key_name='tempest-TestShelveInstance-269156000',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97353e0d7e084a1095d6ae46416d5660',ramdisk_id='',reservation_id='r-68gx34k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1070508789',owner_user_name='tempest-TestShelveInstance-1070508789-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:59:56Z,user_data=None,user_id='5108c5bde1e249a2934f3e47496b1027',uuid=b8c39c58-73b3-4574-9fcf-0c5901a81aa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converting VIF {"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_vif [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-794758f5-f282-42dc-8278-2cd72ac65757 req-05bf1f03-b7af-4ffc-8925-4d9548863777 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-changed-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-794758f5-f282-42dc-8278-2cd72ac65757 req-05bf1f03-b7af-4ffc-8925-4d9548863777 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Refreshing instance network info cache due to event network-changed-b64bd49d-20d0-4f9d-b07c-078a55b0542f. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-794758f5-f282-42dc-8278-2cd72ac65757 req-05bf1f03-b7af-4ffc-8925-4d9548863777 service nova] Acquiring lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-794758f5-f282-42dc-8278-2cd72ac65757 req-05bf1f03-b7af-4ffc-8925-4d9548863777 service nova] Acquired lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.network.neutron [req-794758f5-f282-42dc-8278-2cd72ac65757 req-05bf1f03-b7af-4ffc-8925-4d9548863777 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Refreshing network info cache for port b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb64bd49d-20, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:01:37 user nova-compute[82184]: INFO os_vif [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20')
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEchyUgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:01:37 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e450c7bc-4dea-4cec-be95-b3a43838c8b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:01:37 user nova-compute[82184]: No targets found.
Apr 12 02:01:37 user nova-compute[82184]: iSNS:
Apr 12 02:01:37 user nova-compute[82184]: No targets found.
Apr 12 02:01:37 user nova-compute[82184]: STATIC:
Apr 12 02:01:37 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f
Apr 12 02:01:37 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:01:37 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:01:37 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 02:01:37 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:01:37 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:01:37 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7
Apr 12 02:01:37 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:01:37 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:01:37 user nova-compute[82184]: FIRMWARE:
Apr 12 02:01:37 user nova-compute[82184]: No targets found.
Apr 12 02:01:37 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:01:37 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:01:37 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d3358e-8327-455f-825f-533548bda9e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72f880b-ad79-4a7c-a79a-8f7a7c62490f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:01:37 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:01:37 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:01:37 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:01:37 user nova-compute[82184]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:01:37 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:01:37 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a814a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7'): ({'sdd'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Removing single pathed devices sdd {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dfb844-3df8-49ba-8e65-ff867de6bd4b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76555167-1824-454f-bad6-c22371c81914]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Flushing IO for device /dev/sdd {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b652c32-b3b0-4c30-8630-f30642a72f20]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3befed0c-12a4-43c0-994e-d192a8b842ba]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.051s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec8c76c-a7a2-4025-bd42-7c61bd2673a3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.145s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e228ba01-0e0d-4ce4-b388-1d70cd726b11]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260]
Apr 12 02:01:37 user nova-compute[82184]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260] successful.
Apr 12 02:01:37 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[926d26d8-b4d6-4a9c-ac98-8a9c99c325b6]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] <== disconnect_volume: return (420ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:01:37 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Deleting instance files /opt/stack/data/nova/instances/b8c39c58-73b3-4574-9fcf-0c5901a81aa0_del
Apr 12 02:01:37 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Deletion of /opt/stack/data/nova/instances/b8c39c58-73b3-4574-9fcf-0c5901a81aa0_del complete
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-a9b4cfaf-e5e8-4d36-b255-0d247cce307f req-4b7e7aff-4eab-4ede-9798-e8194fe3d754 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a9b4cfaf-e5e8-4d36-b255-0d247cce307f req-4b7e7aff-4eab-4ede-9798-e8194fe3d754 service nova] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a9b4cfaf-e5e8-4d36-b255-0d247cce307f req-4b7e7aff-4eab-4ede-9798-e8194fe3d754 service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a9b4cfaf-e5e8-4d36-b255-0d247cce307f req-4b7e7aff-4eab-4ede-9798-e8194fe3d754 service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-a9b4cfaf-e5e8-4d36-b255-0d247cce307f req-4b7e7aff-4eab-4ede-9798-e8194fe3d754 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] No waiting events found dispatching network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:01:37 user nova-compute[82184]: WARNING nova.compute.manager [req-a9b4cfaf-e5e8-4d36-b255-0d247cce307f req-4b7e7aff-4eab-4ede-9798-e8194fe3d754 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received unexpected event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f for instance with vm_state active and task_state shelving.
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.network.neutron [req-794758f5-f282-42dc-8278-2cd72ac65757 req-05bf1f03-b7af-4ffc-8925-4d9548863777 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updated VIF entry in instance network info cache for port b64bd49d-20d0-4f9d-b07c-078a55b0542f. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG nova.network.neutron [req-794758f5-f282-42dc-8278-2cd72ac65757 req-05bf1f03-b7af-4ffc-8925-4d9548863777 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating instance_info_cache with network_info: [{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": null, "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb64bd49d-20", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:01:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-794758f5-f282-42dc-8278-2cd72ac65757 req-05bf1f03-b7af-4ffc-8925-4d9548863777 service nova] Releasing lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNAjeLTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:01:38 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:01:38 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:01:38 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e99a7af-5f6d-4353-88a6-db6b1b33574e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:01:38 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[829ca77c-a409-4685-9b24-fe17ed722adb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56] added
Apr 12 02:01:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[916f885e-b17b-4329-9d3a-ff2842a27b2f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4fe61d-5b26-4ccf-abbf-ce47dda32004]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNAjeLTS {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNAjeLTS" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ab3818-f0f6-427e-bb03-e0cf0c963cfe]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mNAjeLTS'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e58c7c9-db2a-42c1-849c-ea4ae635a198]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf94b28-1715-44c0-960d-7b00e82b0e51]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:01:38 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:01:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:01:38 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:01:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eeb1e3-f1b7-430e-987c-a11b6da3827c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56, portal: 172.16.0.220,3260]
Apr 12 02:01:38 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56, portal: 172.16.0.220,3260] successful.
Apr 12 02:01:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf5bdfd-3aa2-4459-8eaf-f151cfc4993d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c055e7ee-6bc1-4945-81b9-9bf2501a112f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:01:38 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:01:38 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:01:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:01:38 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:01:38 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:01:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05827fda-0cd2-4680-9a55-2a1d8f45751b]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNAjeLTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:01:38 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Deleted allocations for instance b8c39c58-73b3-4574-9fcf-0c5901a81aa0
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:38 user nova-compute[82184]: DEBUG nova.objects.instance [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lazy-loading 'numa_topology' on Instance uuid b8c39c58-73b3-4574-9fcf-0c5901a81aa0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d3589ec7-2147-4b65-b8e1-a244ffcee1f6 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.763s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26232626137623733', 'path': '/dev/sdc'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232626137623733', 'path': '/dev/sdc'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'flavor' on Instance uuid 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:01:39 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:01:39 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 02:01:39 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:01:39 user nova-compute[82184]:   <serial>7353ae0d-d613-4966-adae-68aa36212f56</serial>
Apr 12 02:01:39 user nova-compute[82184]: </disk>
Apr 12 02:01:39 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No VIF found with MAC fa:16:3e:92:85:d6, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:01:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d97e8af-edb1-43c4-a5e8-8f722d0511b3 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.431s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:01:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:43 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:01:43 user nova-compute[82184]: INFO nova.compute.claims [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Claim successful on node user
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.network.neutron [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:01:44 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.policy [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '189b7aba48014bedacfa021cc3cad5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2acf278c981e481fbe43e415c76aa6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:01:44 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Creating image(s)
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "/opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "/opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk 1073741824" returned: 0 in 0.047s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Cannot resize image /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:01:44 user nova-compute[82184]: DEBUG nova.objects.instance [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'migration_context' on Instance uuid 0fa3c7e6-a1a9-490e-ae02-8b1359736485 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:01:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:01:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Ensure instance console log exists: /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:01:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:45 user nova-compute[82184]: DEBUG nova.network.neutron [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Successfully created port: bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.neutron [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Successfully updated port: bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "refresh_cache-0fa3c7e6-a1a9-490e-ae02-8b1359736485" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquired lock "refresh_cache-0fa3c7e6-a1a9-490e-ae02-8b1359736485" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.neutron [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-915f1c45-79c7-42a2-905d-8a7d7f1ee290 req-b7d394fe-fda1-4676-a900-00cbc5040b67 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received event network-changed-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-915f1c45-79c7-42a2-905d-8a7d7f1ee290 req-b7d394fe-fda1-4676-a900-00cbc5040b67 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Refreshing instance network info cache due to event network-changed-bee74d19-41d7-4f0a-8ead-0f835edb08f5. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-915f1c45-79c7-42a2-905d-8a7d7f1ee290 req-b7d394fe-fda1-4676-a900-00cbc5040b67 service nova] Acquiring lock "refresh_cache-0fa3c7e6-a1a9-490e-ae02-8b1359736485" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.neutron [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.neutron [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Updating instance_info_cache with network_info: [{"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Releasing lock "refresh_cache-0fa3c7e6-a1a9-490e-ae02-8b1359736485" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Instance network_info: |[{"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-915f1c45-79c7-42a2-905d-8a7d7f1ee290 req-b7d394fe-fda1-4676-a900-00cbc5040b67 service nova] Acquired lock "refresh_cache-0fa3c7e6-a1a9-490e-ae02-8b1359736485" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.neutron [req-915f1c45-79c7-42a2-905d-8a7d7f1ee290 req-b7d394fe-fda1-4676-a900-00cbc5040b67 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Refreshing network info cache for port bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Start _get_guest_xml network_info=[{"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:01:46 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:01:46 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1914850466',display_name='tempest-AttachVolumeNegativeTest-server-1914850466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1914850466',id=26,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVpgpX5yJOQZe/kmK27+zCnCpAv8hp5n1Z5z/6JfKL7n0TJHIZd3wBN6t2NstleJwX5uAbZaPwEfvUa6lQVO8DYrciFuHQtC2fskesOJygGb1X0B1D27t35FhlYWtvnlw==',key_name='tempest-keypair-1196686774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-n82zija5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=0fa3c7e6-a1a9-490e-ae02-8b1359736485,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3d:b3,bridge_name='br-int',has_traffic_filtering=True,id=bee74d19-41d7-4f0a-8ead-0f835edb08f5,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee74d19-41') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.objects.instance [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fa3c7e6-a1a9-490e-ae02-8b1359736485 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:01:46 user nova-compute[82184]:   <uuid>0fa3c7e6-a1a9-490e-ae02-8b1359736485</uuid>
Apr 12 02:01:46 user nova-compute[82184]:   <name>instance-0000001a</name>
Apr 12 02:01:46 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:01:46 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:01:46 user nova-compute[82184]:   <metadata>
Apr 12 02:01:46 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:01:46 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:01:46 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1914850466</nova:name>
Apr 12 02:01:46 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:01:46</nova:creationTime>
Apr 12 02:01:46 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:01:46 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:01:46 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:01:46 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:01:46 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:01:46 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:01:46 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:01:46 user nova-compute[82184]:       <nova:owner>
Apr 12 02:01:46 user nova-compute[82184]:         <nova:user uuid="189b7aba48014bedacfa021cc3cad5e4">tempest-AttachVolumeNegativeTest-1849748479-project-member</nova:user>
Apr 12 02:01:46 user nova-compute[82184]:         <nova:project uuid="2acf278c981e481fbe43e415c76aa6e7">tempest-AttachVolumeNegativeTest-1849748479</nova:project>
Apr 12 02:01:46 user nova-compute[82184]:       </nova:owner>
Apr 12 02:01:46 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:01:46 user nova-compute[82184]:       <nova:ports>
Apr 12 02:01:46 user nova-compute[82184]:         <nova:port uuid="bee74d19-41d7-4f0a-8ead-0f835edb08f5">
Apr 12 02:01:46 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 02:01:46 user nova-compute[82184]:         </nova:port>
Apr 12 02:01:46 user nova-compute[82184]:       </nova:ports>
Apr 12 02:01:46 user nova-compute[82184]:     </nova:instance>
Apr 12 02:01:46 user nova-compute[82184]:   </metadata>
Apr 12 02:01:46 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:01:46 user nova-compute[82184]:     <system>
Apr 12 02:01:46 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:01:46 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:01:46 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:01:46 user nova-compute[82184]:       <entry name="serial">0fa3c7e6-a1a9-490e-ae02-8b1359736485</entry>
Apr 12 02:01:46 user nova-compute[82184]:       <entry name="uuid">0fa3c7e6-a1a9-490e-ae02-8b1359736485</entry>
Apr 12 02:01:46 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:01:46 user nova-compute[82184]:     </system>
Apr 12 02:01:46 user nova-compute[82184]:   </sysinfo>
Apr 12 02:01:46 user nova-compute[82184]:   <os>
Apr 12 02:01:46 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:01:46 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:01:46 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:01:46 user nova-compute[82184]:   </os>
Apr 12 02:01:46 user nova-compute[82184]:   <features>
Apr 12 02:01:46 user nova-compute[82184]:     <acpi/>
Apr 12 02:01:46 user nova-compute[82184]:     <apic/>
Apr 12 02:01:46 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:01:46 user nova-compute[82184]:   </features>
Apr 12 02:01:46 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:01:46 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:01:46 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:01:46 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:01:46 user nova-compute[82184]:   </clock>
Apr 12 02:01:46 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:01:46 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:01:46 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:01:46 user nova-compute[82184]:   </cpu>
Apr 12 02:01:46 user nova-compute[82184]:   <devices>
Apr 12 02:01:46 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:01:46 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:01:46 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk"/>
Apr 12 02:01:46 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:01:46 user nova-compute[82184]:     </disk>
Apr 12 02:01:46 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:01:46 user nova-compute[82184]:       <mac address="fa:16:3e:de:3d:b3"/>
Apr 12 02:01:46 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:01:46 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:01:46 user nova-compute[82184]:       <target dev="tapbee74d19-41"/>
Apr 12 02:01:46 user nova-compute[82184]:     </interface>
Apr 12 02:01:46 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:01:46 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/console.log" append="off"/>
Apr 12 02:01:46 user nova-compute[82184]:     </serial>
Apr 12 02:01:46 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:01:46 user nova-compute[82184]:     <video>
Apr 12 02:01:46 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:01:46 user nova-compute[82184]:     </video>
Apr 12 02:01:46 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:01:46 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:01:46 user nova-compute[82184]:     </rng>
Apr 12 02:01:46 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:01:46 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:01:46 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:01:46 user nova-compute[82184]:     </memballoon>
Apr 12 02:01:46 user nova-compute[82184]:   </devices>
Apr 12 02:01:46 user nova-compute[82184]: </domain>
Apr 12 02:01:46 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1914850466',display_name='tempest-AttachVolumeNegativeTest-server-1914850466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1914850466',id=26,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVpgpX5yJOQZe/kmK27+zCnCpAv8hp5n1Z5z/6JfKL7n0TJHIZd3wBN6t2NstleJwX5uAbZaPwEfvUa6lQVO8DYrciFuHQtC2fskesOJygGb1X0B1D27t35FhlYWtvnlw==',key_name='tempest-keypair-1196686774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-n82zija5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=0fa3c7e6-a1a9-490e-ae02-8b1359736485,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3d:b3,bridge_name='br-int',has_traffic_filtering=True,id=bee74d19-41d7-4f0a-8ead-0f835edb08f5,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee74d19-41') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG os_vif [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3d:b3,bridge_name='br-int',has_traffic_filtering=True,id=bee74d19-41d7-4f0a-8ead-0f835edb08f5,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee74d19-41') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbee74d19-41, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbee74d19-41, col_values=(('external_ids', {'iface-id': 'bee74d19-41d7-4f0a-8ead-0f835edb08f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:3d:b3', 'vm-uuid': '0fa3c7e6-a1a9-490e-ae02-8b1359736485'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:46 user nova-compute[82184]: INFO os_vif [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3d:b3,bridge_name='br-int',has_traffic_filtering=True,id=bee74d19-41d7-4f0a-8ead-0f835edb08f5,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee74d19-41')
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No VIF found with MAC fa:16:3e:de:3d:b3, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.neutron [req-915f1c45-79c7-42a2-905d-8a7d7f1ee290 req-b7d394fe-fda1-4676-a900-00cbc5040b67 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Updated VIF entry in instance network info cache for port bee74d19-41d7-4f0a-8ead-0f835edb08f5. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG nova.network.neutron [req-915f1c45-79c7-42a2-905d-8a7d7f1ee290 req-b7d394fe-fda1-4676-a900-00cbc5040b67 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Updating instance_info_cache with network_info: [{"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:01:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-915f1c45-79c7-42a2-905d-8a7d7f1ee290 req-b7d394fe-fda1-4676-a900-00cbc5040b67 service nova] Releasing lock "refresh_cache-0fa3c7e6-a1a9-490e-ae02-8b1359736485" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:01:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:01:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:01:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:01:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e2a7589-aff1-4292-8f90-f246e8269664 req-abcd538b-f477-4315-bbe9-8055a9d351b1 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received event network-vif-plugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e2a7589-aff1-4292-8f90-f246e8269664 req-abcd538b-f477-4315-bbe9-8055a9d351b1 service nova] Acquiring lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e2a7589-aff1-4292-8f90-f246e8269664 req-abcd538b-f477-4315-bbe9-8055a9d351b1 service nova] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e2a7589-aff1-4292-8f90-f246e8269664 req-abcd538b-f477-4315-bbe9-8055a9d351b1 service nova] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e2a7589-aff1-4292-8f90-f246e8269664 req-abcd538b-f477-4315-bbe9-8055a9d351b1 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] No waiting events found dispatching network-vif-plugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:01:48 user nova-compute[82184]: WARNING nova.compute.manager [req-2e2a7589-aff1-4292-8f90-f246e8269664 req-abcd538b-f477-4315-bbe9-8055a9d351b1 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received unexpected event network-vif-plugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 for instance with vm_state building and task_state spawning.
Apr 12 02:01:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:48 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264909.9470294, 0fa3c7e6-a1a9-490e-ae02-8b1359736485 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:01:49 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] VM Resumed (Lifecycle Event)
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:01:49 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Instance spawned successfully.
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:01:49 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:01:49 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264909.950846, 0fa3c7e6-a1a9-490e-ae02-8b1359736485 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:01:49 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] VM Started (Lifecycle Event)
Apr 12 02:01:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:01:50 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:01:50 user nova-compute[82184]: INFO nova.compute.manager [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Took 5.69 seconds to spawn the instance on the hypervisor.
Apr 12 02:01:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-433cd91f-bbeb-4878-a435-70a8de6e114d req-9ac45195-863e-4321-b6b4-b1a537a94fba service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received event network-vif-plugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-433cd91f-bbeb-4878-a435-70a8de6e114d req-9ac45195-863e-4321-b6b4-b1a537a94fba service nova] Acquiring lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-433cd91f-bbeb-4878-a435-70a8de6e114d req-9ac45195-863e-4321-b6b4-b1a537a94fba service nova] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-433cd91f-bbeb-4878-a435-70a8de6e114d req-9ac45195-863e-4321-b6b4-b1a537a94fba service nova] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-433cd91f-bbeb-4878-a435-70a8de6e114d req-9ac45195-863e-4321-b6b4-b1a537a94fba service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] No waiting events found dispatching network-vif-plugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:01:50 user nova-compute[82184]: WARNING nova.compute.manager [req-433cd91f-bbeb-4878-a435-70a8de6e114d req-9ac45195-863e-4321-b6b4-b1a537a94fba service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received unexpected event network-vif-plugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 for instance with vm_state building and task_state spawning.
Apr 12 02:01:50 user nova-compute[82184]: INFO nova.compute.manager [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Took 6.37 seconds to build instance.
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-500e18cf-b526-44ba-88f0-b411f2dd8191 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.465s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264896.204534, b8c39c58-73b3-4574-9fcf-0c5901a81aa0 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:01:51 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] VM Stopped (Lifecycle Event)
Apr 12 02:01:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f20dff12-6e28-4859-bc63-4f997d19025c None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:01:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:01:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:01:53 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:01:53 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8019MB free_disk=26.424816131591797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 84b4902c-24d9-4e96-b51f-e93e913aa681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 8c37378d-17a9-42a1-abfc-00037e305d34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance cf8cad76-0623-48a0-8b77-bb94218e17a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 0fa3c7e6-a1a9-490e-ae02-8b1359736485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:01:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:01:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:01:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:01:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:01:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:01:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:01:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:01:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:01:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:01:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:02:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:08 user nova-compute[82184]: INFO nova.compute.manager [None req-59294830-9287-4136-8831-7ed4a9a64297 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Unrescuing
Apr 12 02:02:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59294830-9287-4136-8831-7ed4a9a64297 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:02:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59294830-9287-4136-8831-7ed4a9a64297 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquired lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:02:08 user nova-compute[82184]: DEBUG nova.network.neutron [None req-59294830-9287-4136-8831-7ed4a9a64297 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-59294830-9287-4136-8831-7ed4a9a64297 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updating instance_info_cache with network_info: [{"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59294830-9287-4136-8831-7ed4a9a64297 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Releasing lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG nova.objects.instance [None req-59294830-9287-4136-8831-7ed4a9a64297 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'flavor' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-9b9b939a-8d57-47a0-84dd-ee9dae454b39 req-f10572dc-dfac-4ac8-b3ee-a386c4747c8a service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-changed-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-9b9b939a-8d57-47a0-84dd-ee9dae454b39 req-f10572dc-dfac-4ac8-b3ee-a386c4747c8a service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Refreshing instance network info cache due to event network-changed-482853e3-5a37-4420-a614-c01ba39cfb74. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9b9b939a-8d57-47a0-84dd-ee9dae454b39 req-f10572dc-dfac-4ac8-b3ee-a386c4747c8a service nova] Acquiring lock "refresh_cache-8c37378d-17a9-42a1-abfc-00037e305d34" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9b9b939a-8d57-47a0-84dd-ee9dae454b39 req-f10572dc-dfac-4ac8-b3ee-a386c4747c8a service nova] Acquired lock "refresh_cache-8c37378d-17a9-42a1-abfc-00037e305d34" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG nova.network.neutron [req-9b9b939a-8d57-47a0-84dd-ee9dae454b39 req-f10572dc-dfac-4ac8-b3ee-a386c4747c8a service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Refreshing network info cache for port 482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-2ed8c89c-d571-4a54-89e6-c7f94b8843bb req-4f756b7a-1818-4aea-bb04-cc24a9cc89d0 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-unplugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2ed8c89c-d571-4a54-89e6-c7f94b8843bb req-4f756b7a-1818-4aea-bb04-cc24a9cc89d0 service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2ed8c89c-d571-4a54-89e6-c7f94b8843bb req-4f756b7a-1818-4aea-bb04-cc24a9cc89d0 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2ed8c89c-d571-4a54-89e6-c7f94b8843bb req-4f756b7a-1818-4aea-bb04-cc24a9cc89d0 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-2ed8c89c-d571-4a54-89e6-c7f94b8843bb req-4f756b7a-1818-4aea-bb04-cc24a9cc89d0 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-unplugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:09 user nova-compute[82184]: WARNING nova.compute.manager [req-2ed8c89c-d571-4a54-89e6-c7f94b8843bb req-4f756b7a-1818-4aea-bb04-cc24a9cc89d0 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-unplugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state rescued and task_state unrescuing.
Apr 12 02:02:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:10 user nova-compute[82184]: DEBUG nova.network.neutron [req-9b9b939a-8d57-47a0-84dd-ee9dae454b39 req-f10572dc-dfac-4ac8-b3ee-a386c4747c8a service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Updated VIF entry in instance network info cache for port 482853e3-5a37-4420-a614-c01ba39cfb74. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:02:10 user nova-compute[82184]: DEBUG nova.network.neutron [req-9b9b939a-8d57-47a0-84dd-ee9dae454b39 req-f10572dc-dfac-4ac8-b3ee-a386c4747c8a service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Updating instance_info_cache with network_info: [{"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:02:10 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Instance destroyed successfully.
Apr 12 02:02:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9b9b939a-8d57-47a0-84dd-ee9dae454b39 req-f10572dc-dfac-4ac8-b3ee-a386c4747c8a service nova] Releasing lock "refresh_cache-8c37378d-17a9-42a1-abfc-00037e305d34" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG nova.objects.instance [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:11 user nova-compute[82184]: INFO nova.compute.manager [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Attaching volume 6f0ad3fc-378c-4429-b7b6-f5228cf3a42d to /dev/vdb
Apr 12 02:02:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG os_brick.utils [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06598bc-6b36-4976-a7a0-9dd934eab49e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d76143f-7ed9-4460-81ae-65f729c9f33a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25e09cf-b493-4db0-b4f4-bd662501dce2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e0e45c-7b4a-434c-af4b-3a82a9e83be0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:02:11 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:02:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eb5d98-8be5-4138-bcdc-a0d8c6c65aea]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG os_brick.utils [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Updating existing volume attachment record: 547a461e-2947-4927-896c-e3ec3717bbbf {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:02:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:12 user nova-compute[82184]: WARNING nova.compute.manager [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state rescued and task_state unrescuing.
Apr 12 02:02:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:12 user nova-compute[82184]: WARNING nova.compute.manager [req-c7505392-2c65-4f2c-94e9-2e92dc5f9ae9 req-62e5c034-3c54-440b-8594-6fd3a4e9dce0 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state rescued and task_state unrescuing.
Apr 12 02:02:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for 84b4902c-24d9-4e96-b51f-e93e913aa681 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 02:02:13 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264933.822475, 84b4902c-24d9-4e96-b51f-e93e913aa681 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:02:13 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] VM Resumed (Lifecycle Event)
Apr 12 02:02:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-59294830-9287-4136-8831-7ed4a9a64297 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:02:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:02:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:02:13 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 02:02:13 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264933.823027, 84b4902c-24d9-4e96-b51f-e93e913aa681 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:02:13 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] VM Started (Lifecycle Event)
Apr 12 02:02:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:02:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:02:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-bcc1484b-a2e6-4c50-ad6d-cd03198fb042 req-de45d38d-08cc-4d0f-aafb-81cb49b4ee68 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bcc1484b-a2e6-4c50-ad6d-cd03198fb042 req-de45d38d-08cc-4d0f-aafb-81cb49b4ee68 service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bcc1484b-a2e6-4c50-ad6d-cd03198fb042 req-de45d38d-08cc-4d0f-aafb-81cb49b4ee68 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bcc1484b-a2e6-4c50-ad6d-cd03198fb042 req-de45d38d-08cc-4d0f-aafb-81cb49b4ee68 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-bcc1484b-a2e6-4c50-ad6d-cd03198fb042 req-de45d38d-08cc-4d0f-aafb-81cb49b4ee68 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:14 user nova-compute[82184]: WARNING nova.compute.manager [req-bcc1484b-a2e6-4c50-ad6d-cd03198fb042 req-de45d38d-08cc-4d0f-aafb-81cb49b4ee68 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state active and task_state None.
Apr 12 02:02:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RghyewvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:02:16 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:02:16 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:02:16 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f93342-10a7-439c-bc8d-4313c4ca9dca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:02:16 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f65c392-5bb1-47e9-b0ef-97525203b4ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d] added
Apr 12 02:02:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fadaf2a-9795-4154-ba0e-22e5864edc70]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3441b5ac-e609-4ea0-bba1-fac055271f8b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RghyewvC {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RghyewvC" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e87373-d8e4-4757-be18-9e53122eeac0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RghyewvC'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1eeeef-3d13-4a30-af07-f1d730d8e397]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf0d120-bdad-45ba-b52d-42a3c03ffd22]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:16 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:16 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:16 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:16 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc08115c-1f6b-4271-86f7-4ea3af26ba85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d, portal: 172.16.0.220,3260]
Apr 12 02:02:16 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d, portal: 172.16.0.220,3260] successful.
Apr 12 02:02:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d7d56f-efa2-4cea-91cc-3fcc792c9119]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e1fb51-1c61-4ee7-9a67-776179d57647]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:16 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:16 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:16 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:16 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:16 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:16 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb389a4-4fe3-4aa8-9c52-c813950a8dc5]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RghyewvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:02:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:02:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26331613536623238', 'path': '/dev/sdd'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:02:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331613536623238', 'path': '/dev/sdd'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:02:17 user nova-compute[82184]: DEBUG nova.objects.instance [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:02:17 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:02:17 user nova-compute[82184]:   <source dev="/dev/sdd"/>
Apr 12 02:02:17 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:02:17 user nova-compute[82184]:   <serial>6f0ad3fc-378c-4429-b7b6-f5228cf3a42d</serial>
Apr 12 02:02:17 user nova-compute[82184]: </disk>
Apr 12 02:02:17 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:02:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:02:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:02:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No VIF found with MAC fa:16:3e:cc:1d:68, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:02:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17b3e4f0-bdb7-4f7c-a41f-c567da47c359 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.542s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:18 user nova-compute[82184]: DEBUG nova.objects.instance [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'flavor' on Instance uuid cf8cad76-0623-48a0-8b77-bb94218e17a9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Ignoring supplied device name: /dev/vdb
Apr 12 02:02:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:19 user nova-compute[82184]: INFO nova.compute.manager [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Attaching volume df839fb4-cc91-451c-97ba-274b05b51147 to /dev/vdb
Apr 12 02:02:19 user nova-compute[82184]: DEBUG os_brick.utils [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcc5aec-da38-4410-b278-9bc843e58e53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f694db3-92da-4e06-94b0-a43734fa6abb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a044aa-6495-4155-b085-eb2656565315]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39aff10-81c5-495f-ba77-fcfc7be87b7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:02:19 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:02:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1677d6-b384-4c43-97a5-e7ae9de0526a]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG os_brick.utils [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:02:19 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Updating existing volume attachment record: 17b5f5e6-465f-46ff-92e9-7102acf278ea {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:02:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:20 user nova-compute[82184]: DEBUG nova.objects.instance [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:21 user nova-compute[82184]: INFO nova.compute.manager [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Attaching volume 86b90a95-c0be-4069-b9ee-7f0edf77dee7 to /dev/vdc
Apr 12 02:02:21 user nova-compute[82184]: DEBUG os_brick.utils [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4c1222-f611-4b6d-bdcf-1a964e5fba7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2998b122-263e-431a-9b59-4549c51a356c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada484e3-6b17-4c3a-ac52-1655a237b5e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54868b6a-f715-4296-b797-579a36d5b7af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:02:21 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:02:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[673ea425-1e89-45f6-bed0-f753d8ccf2f7]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG os_brick.utils [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Updating existing volume attachment record: 7b4e4414-e91f-40b4-9a35-dc4d38a84344 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:02:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrKbJIfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:02:24 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:02:24 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:02:24 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afba9cf-6f3b-46f7-88e9-871b0dda0181]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:02:24 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc32546-df18-4863-a496-d6510f9e0880]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147] added
Apr 12 02:02:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f81bda-0096-417e-8bde-f539b2c2c13c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80557df-02f7-4fc6-97f3-d25ef5be429c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrKbJIfg {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrKbJIfg" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa21d49-f75e-454a-a03f-0a4f6aee25ca]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UrKbJIfg'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87dce8f-f6ed-40f0-b7ca-cf0a6bd4ca36]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6805b5ec-31de-4b6f-b724-0819bf580777]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f83890-bd8e-4940-bc86-4f9a422b69f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147, portal: 172.16.0.220,3260]
Apr 12 02:02:24 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147, portal: 172.16.0.220,3260] successful.
Apr 12 02:02:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d9bb0d-eeb2-46b5-968f-32278af1dbbc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a7818-c502-4ac6-9e11-336bc7c49cfb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:24 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30eccc2-2c4f-4439-bc27-4a6c05cf3d52]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:02:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrKbJIfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:02:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:02:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23331336136643866', 'path': '/dev/sdf'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:02:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331336136643866', 'path': '/dev/sdf'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:02:25 user nova-compute[82184]: DEBUG nova.objects.instance [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'flavor' on Instance uuid cf8cad76-0623-48a0-8b77-bb94218e17a9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:02:25 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:02:25 user nova-compute[82184]:   <source dev="/dev/sdf"/>
Apr 12 02:02:25 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:02:25 user nova-compute[82184]:   <serial>df839fb4-cc91-451c-97ba-274b05b51147</serial>
Apr 12 02:02:25 user nova-compute[82184]: </disk>
Apr 12 02:02:25 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] No VIF found with MAC fa:16:3e:9f:b3:60, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1f4b7729-f0c0-4bb1-8a50-05b77d00b8d8 tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.221s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWJrZatw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:02:26 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:02:26 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:02:26 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad97c0f6-2838-49df-bb6b-b5a8d388877b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:02:26 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b06d63-857e-412f-b1ab-454d08ddd728]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7] added
Apr 12 02:02:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba52b74-949b-468c-b845-d4a1fc917231]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[836183bd-4a33-434a-bb75-96663797281c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWJrZatw {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWJrZatw" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a175dfb7-aea4-4eb0-8a85-2aad345176c9]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lWJrZatw'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f02104a-3f5f-4650-a15c-e8936dd6995c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1be0c5-dc79-465d-adfd-66e180f16804]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[900f1afc-cab6-4987-ae84-68d38fcc15e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7, portal: 172.16.0.220,3260]
Apr 12 02:02:26 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7, portal: 172.16.0.220,3260] successful.
Apr 12 02:02:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40efc26-4c3e-4290-a5a6-71c53e257150]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a9599a-653c-4984-9ee1-f4815dc61c1b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 (non-flash)
Apr 12 02:02:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:26 user nova-compute[82184]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 (non-flash)
Apr 12 02:02:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b76964-5f24-4cb3-9119-fc319137fcea]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:02:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWJrZatw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:02:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:02:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23965313465373137', 'path': '/dev/sdg'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:02:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965313465373137', 'path': '/dev/sdg'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:02:27 user nova-compute[82184]: DEBUG nova.objects.instance [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:02:27 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:02:27 user nova-compute[82184]:   <source dev="/dev/sdg"/>
Apr 12 02:02:27 user nova-compute[82184]:   <target dev="vdc" bus="virtio"/>
Apr 12 02:02:27 user nova-compute[82184]:   <serial>86b90a95-c0be-4069-b9ee-7f0edf77dee7</serial>
Apr 12 02:02:27 user nova-compute[82184]: </disk>
Apr 12 02:02:27 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:02:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:02:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:02:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:02:28 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] No VIF found with MAC fa:16:3e:cc:1d:68, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:02:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ad8e127c-78b0-43a7-978d-c61c5f6ffb37 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.114s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:29 user nova-compute[82184]: INFO nova.compute.manager [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Detaching volume 6f0ad3fc-378c-4429-b7b6-f5228cf3a42d
Apr 12 02:02:29 user nova-compute[82184]: INFO nova.virt.block_device [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Attempting to driver detach volume 6f0ad3fc-378c-4429-b7b6-f5228cf3a42d from mountpoint /dev/vdb
Apr 12 02:02:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Attempting to detach device vdb from instance 8c37378d-17a9-42a1-abfc-00037e305d34 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:02:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:02:29 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:02:29 user nova-compute[82184]:   <source dev="/dev/sdd"/>
Apr 12 02:02:29 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:02:29 user nova-compute[82184]:   <serial>6f0ad3fc-378c-4429-b7b6-f5228cf3a42d</serial>
Apr 12 02:02:29 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:02:29 user nova-compute[82184]: </disk>
Apr 12 02:02:29 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:02:29 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully detached device vdb from instance 8c37378d-17a9-42a1-abfc-00037e305d34 from the persistent domain config.
Apr 12 02:02:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c37378d-17a9-42a1-abfc-00037e305d34 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:02:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:02:29 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:02:29 user nova-compute[82184]:   <source dev="/dev/sdd"/>
Apr 12 02:02:29 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:02:29 user nova-compute[82184]:   <serial>6f0ad3fc-378c-4429-b7b6-f5228cf3a42d</serial>
Apr 12 02:02:29 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:02:29 user nova-compute[82184]: </disk>
Apr 12 02:02:29 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:02:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264949.996069, 8c37378d-17a9-42a1-abfc-00037e305d34 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:02:30 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully detached device vdb from instance 8c37378d-17a9-42a1-abfc-00037e305d34 from the live domain config.
Apr 12 02:02:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RghyewvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:02:30 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ded372-69ef-4a53-bd41-7ede0420fba3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:02:30 user nova-compute[82184]: No targets found.
Apr 12 02:02:30 user nova-compute[82184]: iSNS:
Apr 12 02:02:30 user nova-compute[82184]: No targets found.
Apr 12 02:02:30 user nova-compute[82184]: STATIC:
Apr 12 02:02:30 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147
Apr 12 02:02:30 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:30 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:30 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f
Apr 12 02:02:30 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:30 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:30 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 02:02:30 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:30 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:30 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56
Apr 12 02:02:30 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:30 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:30 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d
Apr 12 02:02:30 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:30 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:30 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7
Apr 12 02:02:30 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:30 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:30 user nova-compute[82184]: FIRMWARE:
Apr 12 02:02:30 user nova-compute[82184]: No targets found.
Apr 12 02:02:30 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:02:30 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:02:30 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[31294df4-bcd5-45de-953e-39a274bab0d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47986ab-a69f-4a77-9d3e-8ecdde5e87a3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:30 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:30 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:30 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:30 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:30 user nova-compute[82184]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 (non-flash)
Apr 12 02:02:30 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:30 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:30 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:30 user nova-compute[82184]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d (non-flash)
Apr 12 02:02:30 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:30 user nova-compute[82184]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 (non-flash)
Apr 12 02:02:30 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a8210280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d'): ({'sdd'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Removing single pathed devices sdd {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd43e6e5-317c-4e1d-acdb-1b133e3b8bbb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f543dc-92e5-47cd-84f4-8879017e06a1]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flushing IO for device /dev/sdd {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2d1b9d-abf8-49b0-b419-8308961122c4]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16de7177-f59a-4135-9b34-da9abf8f5a34]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bf5d90-a1cd-4bff-a8d9-c8c55b7ba172]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b5a293-f1a2-4aac-8437-3bd8a523049f]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d, portal: 172.16.0.220,3260]
Apr 12 02:02:30 user nova-compute[82184]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d, portal: 172.16.0.220,3260] successful.
Apr 12 02:02:30 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f0ad3fc-378c-4429-b7b6-f5228cf3a42d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17d5757-b30c-4fea-b61e-a0b3b7ba0268]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== disconnect_volume: return (347ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:02:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:02:31 user nova-compute[82184]: DEBUG nova.objects.instance [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-f8e65042-86cd-4b47-ba2a-120e104b1143 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.771s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:31 user nova-compute[82184]: INFO nova.compute.manager [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Detaching volume 86b90a95-c0be-4069-b9ee-7f0edf77dee7
Apr 12 02:02:31 user nova-compute[82184]: INFO nova.virt.block_device [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Attempting to driver detach volume 86b90a95-c0be-4069-b9ee-7f0edf77dee7 from mountpoint /dev/vdc
Apr 12 02:02:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Attempting to detach device vdc from instance 8c37378d-17a9-42a1-abfc-00037e305d34 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:02:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:02:31 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:02:31 user nova-compute[82184]:   <source dev="/dev/sdg"/>
Apr 12 02:02:31 user nova-compute[82184]:   <target dev="vdc" bus="virtio"/>
Apr 12 02:02:31 user nova-compute[82184]:   <serial>86b90a95-c0be-4069-b9ee-7f0edf77dee7</serial>
Apr 12 02:02:31 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 02:02:31 user nova-compute[82184]: </disk>
Apr 12 02:02:31 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:02:31 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully detached device vdc from instance 8c37378d-17a9-42a1-abfc-00037e305d34 from the persistent domain config.
Apr 12 02:02:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8c37378d-17a9-42a1-abfc-00037e305d34 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:02:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:02:31 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:02:31 user nova-compute[82184]:   <source dev="/dev/sdg"/>
Apr 12 02:02:31 user nova-compute[82184]:   <target dev="vdc" bus="virtio"/>
Apr 12 02:02:31 user nova-compute[82184]:   <serial>86b90a95-c0be-4069-b9ee-7f0edf77dee7</serial>
Apr 12 02:02:31 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 02:02:31 user nova-compute[82184]: </disk>
Apr 12 02:02:31 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264952.3329833, 8c37378d-17a9-42a1-abfc-00037e305d34 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:02:32 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully detached device vdc from instance 8c37378d-17a9-42a1-abfc-00037e305d34 from the live domain config.
Apr 12 02:02:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWJrZatw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:02:32 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[22600aeb-bcce-48c6-a3ae-a13d4faa88aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:02:32 user nova-compute[82184]: No targets found.
Apr 12 02:02:32 user nova-compute[82184]: iSNS:
Apr 12 02:02:32 user nova-compute[82184]: No targets found.
Apr 12 02:02:32 user nova-compute[82184]: STATIC:
Apr 12 02:02:32 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147
Apr 12 02:02:32 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:32 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:32 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f
Apr 12 02:02:32 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:32 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:32 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 02:02:32 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:32 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:32 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56
Apr 12 02:02:32 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:32 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:32 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7
Apr 12 02:02:32 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:32 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:32 user nova-compute[82184]: FIRMWARE:
Apr 12 02:02:32 user nova-compute[82184]: No targets found.
Apr 12 02:02:32 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:02:32 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:02:32 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efec5c2-00c9-4c1b-b0ec-d4fce4a287f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9339209d-c482-495f-aaaf-e81ec8f2a1cb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:32 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:32 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:32 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:32 user nova-compute[82184]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 (non-flash)
Apr 12 02:02:32 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:32 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:32 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:32 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:32 user nova-compute[82184]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 (non-flash)
Apr 12 02:02:32 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a81488b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7'): ({'sdg'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Removing single pathed devices sdg {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e2cdc7-5dd4-48b1-aaf8-8112911f16a0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b67db2b-237a-4fd7-b5ef-f67fa2ce334a]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Flushing IO for device /dev/sdg {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9084d03f-d8eb-48ca-a599-82e624d4cd84]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[616c7900-f8b5-471c-a192-eb4022876fa5]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] SCSI volumes sdg have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d50dea-09b9-4e5d-8ebd-22b59e501ae9]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad39d7-9eda-4de6-a201-b8733ad16a6d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7, portal: 172.16.0.220,3260]
Apr 12 02:02:32 user nova-compute[82184]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7, portal: 172.16.0.220,3260] successful.
Apr 12 02:02:32 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86b90a95-c0be-4069-b9ee-7f0edf77dee7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c15daa0-2ee8-45f3-b89c-2ec0284e7148]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] <== disconnect_volume: return (327ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:02:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:02:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'flavor' on Instance uuid 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e2d037ca-7619-4bc7-8ed8-856e038f4095 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:34 user nova-compute[82184]: INFO nova.compute.manager [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Terminating instance
Apr 12 02:02:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-2b168b96-9939-4be7-a1f3-b626edca795f req-512fcbeb-7b86-4bd1-ac24-5d641ca4dbb4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-vif-unplugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2b168b96-9939-4be7-a1f3-b626edca795f req-512fcbeb-7b86-4bd1-ac24-5d641ca4dbb4 service nova] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2b168b96-9939-4be7-a1f3-b626edca795f req-512fcbeb-7b86-4bd1-ac24-5d641ca4dbb4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2b168b96-9939-4be7-a1f3-b626edca795f req-512fcbeb-7b86-4bd1-ac24-5d641ca4dbb4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-2b168b96-9939-4be7-a1f3-b626edca795f req-512fcbeb-7b86-4bd1-ac24-5d641ca4dbb4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] No waiting events found dispatching network-vif-unplugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-2b168b96-9939-4be7-a1f3-b626edca795f req-512fcbeb-7b86-4bd1-ac24-5d641ca4dbb4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-vif-unplugged-482853e3-5a37-4420-a614-c01ba39cfb74 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:02:34 user nova-compute[82184]: INFO nova.compute.manager [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Detaching volume df839fb4-cc91-451c-97ba-274b05b51147
Apr 12 02:02:34 user nova-compute[82184]: INFO nova.virt.block_device [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Attempting to driver detach volume df839fb4-cc91-451c-97ba-274b05b51147 from mountpoint /dev/vdb
Apr 12 02:02:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Attempting to detach device vdb from instance cf8cad76-0623-48a0-8b77-bb94218e17a9 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:02:34 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:02:34 user nova-compute[82184]:   <source dev="/dev/sdf"/>
Apr 12 02:02:34 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:02:34 user nova-compute[82184]:   <serial>df839fb4-cc91-451c-97ba-274b05b51147</serial>
Apr 12 02:02:34 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:02:34 user nova-compute[82184]: </disk>
Apr 12 02:02:34 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:02:34 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Successfully detached device vdb from instance cf8cad76-0623-48a0-8b77-bb94218e17a9 from the persistent domain config.
Apr 12 02:02:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf8cad76-0623-48a0-8b77-bb94218e17a9 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:02:34 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:02:34 user nova-compute[82184]:   <source dev="/dev/sdf"/>
Apr 12 02:02:34 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:02:34 user nova-compute[82184]:   <serial>df839fb4-cc91-451c-97ba-274b05b51147</serial>
Apr 12 02:02:34 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:02:34 user nova-compute[82184]: </disk>
Apr 12 02:02:34 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:02:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681264955.585931, cf8cad76-0623-48a0-8b77-bb94218e17a9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf8cad76-0623-48a0-8b77-bb94218e17a9 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:02:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Successfully detached device vdb from instance cf8cad76-0623-48a0-8b77-bb94218e17a9 from the live domain config.
Apr 12 02:02:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrKbJIfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:02:35 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Instance destroyed successfully.
Apr 12 02:02:35 user nova-compute[82184]: DEBUG nova.objects.instance [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lazy-loading 'resources' on Instance uuid 8c37378d-17a9-42a1-abfc-00037e305d34 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1553393100',display_name='tempest-AttachVolumeTestJSON-server-1553393100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1553393100',id=24,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9PbnZpthoEPBbgAsjmQsY6RgSWKMwste0tDXW/CGuop5MpgsjfMlEApyCMQgwuzCsJ9Gr8VF6fKEHWivLB+lL3P2qNsPHCK4NwqoKfCUSZQWI/Rq+KTRt1Nfy0sVaPxw==',key_name='tempest-keypair-155530966',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:00:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c34bd636a2a54b249dca9ce9027ebf4b',ramdisk_id='',reservation_id='r-d7z480cg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-913560355',owner_user_name='tempest-AttachVolumeTestJSON-913560355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2ca4855c3e9461cb27c88469086d7d8',uuid=8c37378d-17a9-42a1-abfc-00037e305d34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converting VIF {"id": "482853e3-5a37-4420-a614-c01ba39cfb74", "address": "fa:16:3e:cc:1d:68", "network": {"id": "10203cb1-b210-4779-b45b-c0822f9562cb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1576797238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c34bd636a2a54b249dca9ce9027ebf4b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap482853e3-5a", "ovs_interfaceid": "482853e3-5a37-4420-a614-c01ba39cfb74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:1d:68,bridge_name='br-int',has_traffic_filtering=True,id=482853e3-5a37-4420-a614-c01ba39cfb74,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482853e3-5a') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_vif [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:1d:68,bridge_name='br-int',has_traffic_filtering=True,id=482853e3-5a37-4420-a614-c01ba39cfb74,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482853e3-5a') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b06903-3cdf-4b58-ac45-8ddc0b0f9fc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:02:35 user nova-compute[82184]: No targets found.
Apr 12 02:02:35 user nova-compute[82184]: iSNS:
Apr 12 02:02:35 user nova-compute[82184]: No targets found.
Apr 12 02:02:35 user nova-compute[82184]: STATIC:
Apr 12 02:02:35 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147
Apr 12 02:02:35 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:35 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:35 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f
Apr 12 02:02:35 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:35 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:35 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 02:02:35 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:35 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:35 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56
Apr 12 02:02:35 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:35 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:35 user nova-compute[82184]: FIRMWARE:
Apr 12 02:02:35 user nova-compute[82184]: No targets found.
Apr 12 02:02:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:02:35 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:02:35 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap482853e3-5a, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:02:35 user nova-compute[82184]: INFO os_vif [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:1d:68,bridge_name='br-int',has_traffic_filtering=True,id=482853e3-5a37-4420-a614-c01ba39cfb74,network=Network(10203cb1-b210-4779-b45b-c0822f9562cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap482853e3-5a')
Apr 12 02:02:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Deleting instance files /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34_del
Apr 12 02:02:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Deletion of /opt/stack/data/nova/instances/8c37378d-17a9-42a1-abfc-00037e305d34_del complete
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4012652-9583-4030-91ea-3f67c1f29978]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed43db6d-ef11-4b99-9c28-3812b6cdfb90]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:35 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:35 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:35 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:35 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:35 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:35 user nova-compute[82184]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 (non-flash)
Apr 12 02:02:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a829d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147'): ({'sdf'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Removing single pathed devices sdf {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:35 user nova-compute[82184]: INFO nova.compute.manager [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Took 1.23 seconds to destroy the instance on the hypervisor.
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8d1335-ef69-43a6-a770-f3d4b458c684]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b7ff07-08b2-4971-9190-07d01b747abc]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Flushing IO for device /dev/sdf {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[393254b2-4111-44a3-93f4-0105529d0d2e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.059s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1afd8a-d99f-44a7-ad29-a834f3d56e40]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] SCSI volumes sdf have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13d5a60-175a-405b-a9cd-708126a00d13]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d285af-a7ad-4347-8847-3a29888a8502]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147, portal: 172.16.0.220,3260]
Apr 12 02:02:35 user nova-compute[82184]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147, portal: 172.16.0.220,3260] successful.
Apr 12 02:02:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6d07f-df56-4d23-a937-fbfd13ad7169]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] <== disconnect_volume: return (356ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:02:36 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Took 0.81 seconds to deallocate network for instance.
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-61d45770-ef08-46e8-a556-f483782d1df8 req-99206ff1-fec8-4231-a1d6-995125afddf7 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-vif-deleted-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:36 user nova-compute[82184]: INFO nova.compute.manager [req-61d45770-ef08-46e8-a556-f483782d1df8 req-99206ff1-fec8-4231-a1d6-995125afddf7 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Neutron deleted interface 482853e3-5a37-4420-a614-c01ba39cfb74; detaching it from the instance and deleting it from the info cache
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.network.neutron [req-61d45770-ef08-46e8-a556-f483782d1df8 req-99206ff1-fec8-4231-a1d6-995125afddf7 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-61d45770-ef08-46e8-a556-f483782d1df8 req-99206ff1-fec8-4231-a1d6-995125afddf7 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Detach interface failed, port_id=482853e3-5a37-4420-a614-c01ba39cfb74, reason: Instance 8c37378d-17a9-42a1-abfc-00037e305d34 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'flavor' on Instance uuid cf8cad76-0623-48a0-8b77-bb94218e17a9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2c3c71e4-b6f4-488c-a528-ea58de7dc62e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.994s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.866s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:36 user nova-compute[82184]: INFO nova.compute.manager [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Terminating instance
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] No waiting events found dispatching network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:36 user nova-compute[82184]: WARNING nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received unexpected event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 for instance with vm_state deleted and task_state None.
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] No waiting events found dispatching network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:36 user nova-compute[82184]: WARNING nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received unexpected event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 for instance with vm_state deleted and task_state None.
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] No waiting events found dispatching network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:36 user nova-compute[82184]: WARNING nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received unexpected event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 for instance with vm_state deleted and task_state None.
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-vif-unplugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] No waiting events found dispatching network-vif-unplugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:36 user nova-compute[82184]: WARNING nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received unexpected event network-vif-unplugged-482853e3-5a37-4420-a614-c01ba39cfb74 for instance with vm_state deleted and task_state None.
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Acquiring lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] Lock "8c37378d-17a9-42a1-abfc-00037e305d34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] No waiting events found dispatching network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:36 user nova-compute[82184]: WARNING nova.compute.manager [req-b6b869d4-9c6c-4f06-b091-03b595a47536 req-bed1d834-734d-44d9-9411-dfce358de5a4 service nova] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Received unexpected event network-vif-plugged-482853e3-5a37-4420-a614-c01ba39cfb74 for instance with vm_state deleted and task_state None.
Apr 12 02:02:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:36 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Deleted allocations for instance 8c37378d-17a9-42a1-abfc-00037e305d34
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cde5949a-c2b3-4985-b789-73e897e1dd10 tempest-AttachVolumeTestJSON-913560355 tempest-AttachVolumeTestJSON-913560355-project-member] Lock "8c37378d-17a9-42a1-abfc-00037e305d34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.567s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-fc6d09ae-200c-4e42-bd43-a1b1b953457e req-825ab640-d1ea-4c7f-9e66-ba32a97fb8fa service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Received event network-vif-unplugged-409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fc6d09ae-200c-4e42-bd43-a1b1b953457e req-825ab640-d1ea-4c7f-9e66-ba32a97fb8fa service nova] Acquiring lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fc6d09ae-200c-4e42-bd43-a1b1b953457e req-825ab640-d1ea-4c7f-9e66-ba32a97fb8fa service nova] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fc6d09ae-200c-4e42-bd43-a1b1b953457e req-825ab640-d1ea-4c7f-9e66-ba32a97fb8fa service nova] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-fc6d09ae-200c-4e42-bd43-a1b1b953457e req-825ab640-d1ea-4c7f-9e66-ba32a97fb8fa service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] No waiting events found dispatching network-vif-unplugged-409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-fc6d09ae-200c-4e42-bd43-a1b1b953457e req-825ab640-d1ea-4c7f-9e66-ba32a97fb8fa service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Received event network-vif-unplugged-409d9b69-5424-4507-8052-591629d7c44c for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:02:37 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Instance destroyed successfully.
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.objects.instance [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lazy-loading 'resources' on Instance uuid cf8cad76-0623-48a0-8b77-bb94218e17a9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:00:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1013259307',display_name='tempest-VolumesSnapshotTestJSON-instance-1013259307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1013259307',id=25,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:00:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1dbc688a91f547c0adbf929d0f714d51',ramdisk_id='',reservation_id='r-qyza2gae',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1019440197',owner_user_name='tempest-VolumesSnapshotTestJSON-1019440197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:00:35Z,user_data=None,user_id='cb64ad9101674c1a92d41dfd57ca8e15',uuid=cf8cad76-0623-48a0-8b77-bb94218e17a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "409d9b69-5424-4507-8052-591629d7c44c", "address": "fa:16:3e:9f:b3:60", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409d9b69-54", "ovs_interfaceid": "409d9b69-5424-4507-8052-591629d7c44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converting VIF {"id": "409d9b69-5424-4507-8052-591629d7c44c", "address": "fa:16:3e:9f:b3:60", "network": {"id": "c12e9557-d89a-46e7-8232-823d5738fa26", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1515231960-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1dbc688a91f547c0adbf929d0f714d51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap409d9b69-54", "ovs_interfaceid": "409d9b69-5424-4507-8052-591629d7c44c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b3:60,bridge_name='br-int',has_traffic_filtering=True,id=409d9b69-5424-4507-8052-591629d7c44c,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409d9b69-54') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_vif [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b3:60,bridge_name='br-int',has_traffic_filtering=True,id=409d9b69-5424-4507-8052-591629d7c44c,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409d9b69-54') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap409d9b69-54, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:02:37 user nova-compute[82184]: INFO os_vif [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:b3:60,bridge_name='br-int',has_traffic_filtering=True,id=409d9b69-5424-4507-8052-591629d7c44c,network=Network(c12e9557-d89a-46e7-8232-823d5738fa26),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap409d9b69-54')
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrKbJIfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:02:37 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a7e5cc-52f1-4a88-bbba-a83904640d69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:02:37 user nova-compute[82184]: No targets found.
Apr 12 02:02:37 user nova-compute[82184]: iSNS:
Apr 12 02:02:37 user nova-compute[82184]: No targets found.
Apr 12 02:02:37 user nova-compute[82184]: STATIC:
Apr 12 02:02:37 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f
Apr 12 02:02:37 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:37 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:37 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 02:02:37 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:37 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:37 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56
Apr 12 02:02:37 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:02:37 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:02:37 user nova-compute[82184]: FIRMWARE:
Apr 12 02:02:37 user nova-compute[82184]: No targets found.
Apr 12 02:02:37 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:02:37 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:02:37 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df839fb4-cc91-451c-97ba-274b05b51147', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd68a46-fce3-4fa7-9ee7-dcb412d3e750]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f01f163-b7a1-4b36-b847-dae6066548ef]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:37 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:37 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:37 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:02:37 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:02:37 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:02:37 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a829caf0>, {}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Disconnecting from: [] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] <== disconnect_volume: return (72ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:02:37 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Deleting instance files /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9_del
Apr 12 02:02:37 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Deletion of /opt/stack/data/nova/instances/cf8cad76-0623-48a0-8b77-bb94218e17a9_del complete
Apr 12 02:02:37 user nova-compute[82184]: INFO nova.compute.manager [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 12 02:02:37 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:02:37 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:02:38 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:02:38 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Took 0.45 seconds to deallocate network for instance.
Apr 12 02:02:38 user nova-compute[82184]: WARNING nova.volume.cinder [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Attachment 17b5f5e6-465f-46ff-92e9-7102acf278ea does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 17b5f5e6-465f-46ff-92e9-7102acf278ea. (HTTP 404) (Request-ID: req-4768e603-735e-4d07-8dae-b78e2eb1320a)
Apr 12 02:02:38 user nova-compute[82184]: INFO nova.compute.manager [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Took 0.02 seconds to detach 1 volumes for instance.
Apr 12 02:02:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:38 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:02:38 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:02:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:38 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Deleted allocations for instance cf8cad76-0623-48a0-8b77-bb94218e17a9
Apr 12 02:02:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-1071aedc-f998-4694-bd81-82f1316a1648 req-dd4b6c86-18b3-4fc3-854f-4fcac3d63898 service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Received event network-vif-deleted-409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-77fe7136-9e6c-4a81-8703-f03daf8d871e tempest-VolumesSnapshotTestJSON-1019440197 tempest-VolumesSnapshotTestJSON-1019440197-project-member] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.808s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-907077ae-8fcd-4ceb-929d-dc760363105a req-165e8030-0f7a-44a8-bd60-026ef81ed43d service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Received event network-vif-plugged-409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:02:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-907077ae-8fcd-4ceb-929d-dc760363105a req-165e8030-0f7a-44a8-bd60-026ef81ed43d service nova] Acquiring lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-907077ae-8fcd-4ceb-929d-dc760363105a req-165e8030-0f7a-44a8-bd60-026ef81ed43d service nova] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-907077ae-8fcd-4ceb-929d-dc760363105a req-165e8030-0f7a-44a8-bd60-026ef81ed43d service nova] Lock "cf8cad76-0623-48a0-8b77-bb94218e17a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-907077ae-8fcd-4ceb-929d-dc760363105a req-165e8030-0f7a-44a8-bd60-026ef81ed43d service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] No waiting events found dispatching network-vif-plugged-409d9b69-5424-4507-8052-591629d7c44c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:02:39 user nova-compute[82184]: WARNING nova.compute.manager [req-907077ae-8fcd-4ceb-929d-dc760363105a req-165e8030-0f7a-44a8-bd60-026ef81ed43d service nova] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Received unexpected event network-vif-plugged-409d9b69-5424-4507-8052-591629d7c44c for instance with vm_state deleted and task_state None.
Apr 12 02:02:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:02:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:02:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:02:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:02:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:02:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:02:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:02:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:02:48 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:02:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updating instance_info_cache with network_info: [{"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:02:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-fdbd8add-ac0e-42ce-9b34-5878c6bec208" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:02:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:02:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:02:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:02:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:02:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264955.5979915, 8c37378d-17a9-42a1-abfc-00037e305d34 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:02:50 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] VM Stopped (Lifecycle Event)
Apr 12 02:02:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-f5fdb67d-4f3f-45d3-ad56-fa92f4f24040 None None] [instance: 8c37378d-17a9-42a1-abfc-00037e305d34] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:02:52 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:02:52 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8086MB free_disk=26.44870376586914GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264957.5552273, cf8cad76-0623-48a0-8b77-bb94218e17a9 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:02:52 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] VM Stopped (Lifecycle Event)
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-af61c832-3417-427a-9e83-8062acb6f869 None None] [instance: cf8cad76-0623-48a0-8b77-bb94218e17a9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 84b4902c-24d9-4e96-b51f-e93e913aa681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c712f2db-72cb-4136-a719-56057d82fff6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 0fa3c7e6-a1a9-490e-ae02-8b1359736485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:02:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:02:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:02:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:02:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:02:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:02:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:02:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:02:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:02:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:08 user nova-compute[82184]: DEBUG nova.compute.manager [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:03:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:03:08 user nova-compute[82184]: INFO nova.compute.claims [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Claim successful on node user
Apr 12 02:03:09 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:03:09 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:03:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG nova.policy [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34ca83258ae04dee81b8552a6c7e3c2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '910948b97a01432fb70094eb6ec30379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:03:09 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Creating image(s)
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "/opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "/opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "/opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk 1073741824" returned: 0 in 0.047s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.148s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Cannot resize image /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.objects.instance [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'migration_context' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Ensure instance console log exists: /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Successfully created port: 280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Successfully updated port: 280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquired lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-01ace1f9-7b83-48dd-983c-4b5f73b8adcb req-6f0f510b-87fb-47bd-aba7-d864b54e285c service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received event network-changed-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-01ace1f9-7b83-48dd-983c-4b5f73b8adcb req-6f0f510b-87fb-47bd-aba7-d864b54e285c service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Refreshing instance network info cache due to event network-changed-280a0eb1-7bff-42d2-a75e-69eba211ffbb. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-01ace1f9-7b83-48dd-983c-4b5f73b8adcb req-6f0f510b-87fb-47bd-aba7-d864b54e285c service nova] Acquiring lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:03:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updating instance_info_cache with network_info: [{"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Releasing lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Instance network_info: |[{"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-01ace1f9-7b83-48dd-983c-4b5f73b8adcb req-6f0f510b-87fb-47bd-aba7-d864b54e285c service nova] Acquired lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-01ace1f9-7b83-48dd-983c-4b5f73b8adcb req-6f0f510b-87fb-47bd-aba7-d864b54e285c service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Refreshing network info cache for port 280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Start _get_guest_xml network_info=[{"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:03:11 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:03:11 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1689225161',display_name='tempest-SnapshotDataIntegrityTests-server-1689225161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1689225161',id=27,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzPcQjTv2Jael0y5wrvN4uSHK22wC+4MQYihJ4lkSsarIJtgTRNzEUL9q5zwomDyXY8RX+h7kFLUBsKlQRa2wYp3AwqYZTBzQkYcWYnC7AOOfvjs6Z8ppYHAJYpNSM3yg==',key_name='tempest-SnapshotDataIntegrityTests-522022221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='910948b97a01432fb70094eb6ec30379',ramdisk_id='',reservation_id='r-hklkmddv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1739495878',owner_user_name='tempest-SnapshotDataIntegrityTests-1739495878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:03:09Z,user_data=None,user_id='34ca83258ae04dee81b8552a6c7e3c2f',uuid=101410fb-7682-46d8-baf1-18fcebf81cb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Converting VIF {"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=280a0eb1-7bff-42d2-a75e-69eba211ffbb,network=Network(6f35d61b-46c4-4830-984f-93b7bfa8836c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280a0eb1-7b') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.objects.instance [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'pci_devices' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:03:11 user nova-compute[82184]:   <uuid>101410fb-7682-46d8-baf1-18fcebf81cb8</uuid>
Apr 12 02:03:11 user nova-compute[82184]:   <name>instance-0000001b</name>
Apr 12 02:03:11 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:03:11 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:03:11 user nova-compute[82184]:   <metadata>
Apr 12 02:03:11 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:03:11 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:03:11 user nova-compute[82184]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1689225161</nova:name>
Apr 12 02:03:11 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:03:11</nova:creationTime>
Apr 12 02:03:11 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:03:11 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:03:11 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:03:11 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:03:11 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:03:11 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:03:11 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:03:11 user nova-compute[82184]:       <nova:owner>
Apr 12 02:03:11 user nova-compute[82184]:         <nova:user uuid="34ca83258ae04dee81b8552a6c7e3c2f">tempest-SnapshotDataIntegrityTests-1739495878-project-member</nova:user>
Apr 12 02:03:11 user nova-compute[82184]:         <nova:project uuid="910948b97a01432fb70094eb6ec30379">tempest-SnapshotDataIntegrityTests-1739495878</nova:project>
Apr 12 02:03:11 user nova-compute[82184]:       </nova:owner>
Apr 12 02:03:11 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:03:11 user nova-compute[82184]:       <nova:ports>
Apr 12 02:03:11 user nova-compute[82184]:         <nova:port uuid="280a0eb1-7bff-42d2-a75e-69eba211ffbb">
Apr 12 02:03:11 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 02:03:11 user nova-compute[82184]:         </nova:port>
Apr 12 02:03:11 user nova-compute[82184]:       </nova:ports>
Apr 12 02:03:11 user nova-compute[82184]:     </nova:instance>
Apr 12 02:03:11 user nova-compute[82184]:   </metadata>
Apr 12 02:03:11 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:03:11 user nova-compute[82184]:     <system>
Apr 12 02:03:11 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:03:11 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:03:11 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:03:11 user nova-compute[82184]:       <entry name="serial">101410fb-7682-46d8-baf1-18fcebf81cb8</entry>
Apr 12 02:03:11 user nova-compute[82184]:       <entry name="uuid">101410fb-7682-46d8-baf1-18fcebf81cb8</entry>
Apr 12 02:03:11 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:03:11 user nova-compute[82184]:     </system>
Apr 12 02:03:11 user nova-compute[82184]:   </sysinfo>
Apr 12 02:03:11 user nova-compute[82184]:   <os>
Apr 12 02:03:11 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:03:11 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:03:11 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:03:11 user nova-compute[82184]:   </os>
Apr 12 02:03:11 user nova-compute[82184]:   <features>
Apr 12 02:03:11 user nova-compute[82184]:     <acpi/>
Apr 12 02:03:11 user nova-compute[82184]:     <apic/>
Apr 12 02:03:11 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:03:11 user nova-compute[82184]:   </features>
Apr 12 02:03:11 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:03:11 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:03:11 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:03:11 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:03:11 user nova-compute[82184]:   </clock>
Apr 12 02:03:11 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:03:11 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:03:11 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:03:11 user nova-compute[82184]:   </cpu>
Apr 12 02:03:11 user nova-compute[82184]:   <devices>
Apr 12 02:03:11 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:03:11 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:03:11 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk"/>
Apr 12 02:03:11 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:03:11 user nova-compute[82184]:     </disk>
Apr 12 02:03:11 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:03:11 user nova-compute[82184]:       <mac address="fa:16:3e:e2:49:7f"/>
Apr 12 02:03:11 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:03:11 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:03:11 user nova-compute[82184]:       <target dev="tap280a0eb1-7b"/>
Apr 12 02:03:11 user nova-compute[82184]:     </interface>
Apr 12 02:03:11 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:03:11 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/console.log" append="off"/>
Apr 12 02:03:11 user nova-compute[82184]:     </serial>
Apr 12 02:03:11 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:03:11 user nova-compute[82184]:     <video>
Apr 12 02:03:11 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:03:11 user nova-compute[82184]:     </video>
Apr 12 02:03:11 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:03:11 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:03:11 user nova-compute[82184]:     </rng>
Apr 12 02:03:11 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:03:11 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:03:11 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:03:11 user nova-compute[82184]:     </memballoon>
Apr 12 02:03:11 user nova-compute[82184]:   </devices>
Apr 12 02:03:11 user nova-compute[82184]: </domain>
Apr 12 02:03:11 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1689225161',display_name='tempest-SnapshotDataIntegrityTests-server-1689225161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1689225161',id=27,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzPcQjTv2Jael0y5wrvN4uSHK22wC+4MQYihJ4lkSsarIJtgTRNzEUL9q5zwomDyXY8RX+h7kFLUBsKlQRa2wYp3AwqYZTBzQkYcWYnC7AOOfvjs6Z8ppYHAJYpNSM3yg==',key_name='tempest-SnapshotDataIntegrityTests-522022221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='910948b97a01432fb70094eb6ec30379',ramdisk_id='',reservation_id='r-hklkmddv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1739495878',owner_user_name='tempest-SnapshotDataIntegrityTests-1739495878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:03:09Z,user_data=None,user_id='34ca83258ae04dee81b8552a6c7e3c2f',uuid=101410fb-7682-46d8-baf1-18fcebf81cb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Converting VIF {"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=280a0eb1-7bff-42d2-a75e-69eba211ffbb,network=Network(6f35d61b-46c4-4830-984f-93b7bfa8836c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280a0eb1-7b') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG os_vif [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=280a0eb1-7bff-42d2-a75e-69eba211ffbb,network=Network(6f35d61b-46c4-4830-984f-93b7bfa8836c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280a0eb1-7b') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap280a0eb1-7b, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap280a0eb1-7b, col_values=(('external_ids', {'iface-id': '280a0eb1-7bff-42d2-a75e-69eba211ffbb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:49:7f', 'vm-uuid': '101410fb-7682-46d8-baf1-18fcebf81cb8'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:11 user nova-compute[82184]: INFO os_vif [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=280a0eb1-7bff-42d2-a75e-69eba211ffbb,network=Network(6f35d61b-46c4-4830-984f-93b7bfa8836c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280a0eb1-7b')
Apr 12 02:03:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No VIF found with MAC fa:16:3e:e2:49:7f, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-01ace1f9-7b83-48dd-983c-4b5f73b8adcb req-6f0f510b-87fb-47bd-aba7-d864b54e285c service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updated VIF entry in instance network info cache for port 280a0eb1-7bff-42d2-a75e-69eba211ffbb. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-01ace1f9-7b83-48dd-983c-4b5f73b8adcb req-6f0f510b-87fb-47bd-aba7-d864b54e285c service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updating instance_info_cache with network_info: [{"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:03:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-01ace1f9-7b83-48dd-983c-4b5f73b8adcb req-6f0f510b-87fb-47bd-aba7-d864b54e285c service nova] Releasing lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:03:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ffda399-04c3-4d60-9b74-b0215feca3c8 req-08047fb1-212a-4df1-bb5a-8898a3559bc5 service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received event network-vif-plugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ffda399-04c3-4d60-9b74-b0215feca3c8 req-08047fb1-212a-4df1-bb5a-8898a3559bc5 service nova] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ffda399-04c3-4d60-9b74-b0215feca3c8 req-08047fb1-212a-4df1-bb5a-8898a3559bc5 service nova] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ffda399-04c3-4d60-9b74-b0215feca3c8 req-08047fb1-212a-4df1-bb5a-8898a3559bc5 service nova] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ffda399-04c3-4d60-9b74-b0215feca3c8 req-08047fb1-212a-4df1-bb5a-8898a3559bc5 service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] No waiting events found dispatching network-vif-plugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:03:12 user nova-compute[82184]: WARNING nova.compute.manager [req-1ffda399-04c3-4d60-9b74-b0215feca3c8 req-08047fb1-212a-4df1-bb5a-8898a3559bc5 service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received unexpected event network-vif-plugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb for instance with vm_state building and task_state spawning.
Apr 12 02:03:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264994.9093766, 101410fb-7682-46d8-baf1-18fcebf81cb8 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:03:14 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] VM Resumed (Lifecycle Event)
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:03:14 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Instance spawned successfully.
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:03:14 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681264994.9118872, 101410fb-7682-46d8-baf1-18fcebf81cb8 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:03:14 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] VM Started (Lifecycle Event)
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:03:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:03:15 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:03:15 user nova-compute[82184]: INFO nova.compute.manager [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Took 5.52 seconds to spawn the instance on the hypervisor.
Apr 12 02:03:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:03:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-61d447f3-b5a6-4fc5-8581-f0d7b8c117e3 req-caa2148e-6e46-4f2e-98f9-c44375b2a88a service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received event network-vif-plugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-61d447f3-b5a6-4fc5-8581-f0d7b8c117e3 req-caa2148e-6e46-4f2e-98f9-c44375b2a88a service nova] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-61d447f3-b5a6-4fc5-8581-f0d7b8c117e3 req-caa2148e-6e46-4f2e-98f9-c44375b2a88a service nova] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-61d447f3-b5a6-4fc5-8581-f0d7b8c117e3 req-caa2148e-6e46-4f2e-98f9-c44375b2a88a service nova] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-61d447f3-b5a6-4fc5-8581-f0d7b8c117e3 req-caa2148e-6e46-4f2e-98f9-c44375b2a88a service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] No waiting events found dispatching network-vif-plugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:03:15 user nova-compute[82184]: WARNING nova.compute.manager [req-61d447f3-b5a6-4fc5-8581-f0d7b8c117e3 req-caa2148e-6e46-4f2e-98f9-c44375b2a88a service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received unexpected event network-vif-plugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb for instance with vm_state building and task_state spawning.
Apr 12 02:03:15 user nova-compute[82184]: INFO nova.compute.manager [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Took 6.23 seconds to build instance.
Apr 12 02:03:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-848e1b5e-ea85-475f-a095-d7d75c0e5a50 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.322s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:17 user nova-compute[82184]: INFO nova.compute.manager [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Terminating instance
Apr 12 02:03:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-bb66757d-9e22-42de-a3c4-6b53213aa243 req-a8ea294e-1e8d-4d0f-8ebf-07fe45d6f215 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bb66757d-9e22-42de-a3c4-6b53213aa243 req-a8ea294e-1e8d-4d0f-8ebf-07fe45d6f215 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bb66757d-9e22-42de-a3c4-6b53213aa243 req-a8ea294e-1e8d-4d0f-8ebf-07fe45d6f215 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bb66757d-9e22-42de-a3c4-6b53213aa243 req-a8ea294e-1e8d-4d0f-8ebf-07fe45d6f215 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-bb66757d-9e22-42de-a3c4-6b53213aa243 req-a8ea294e-1e8d-4d0f-8ebf-07fe45d6f215 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:03:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-bb66757d-9e22-42de-a3c4-6b53213aa243 req-a8ea294e-1e8d-4d0f-8ebf-07fe45d6f215 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-unplugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:03:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Instance destroyed successfully.
Apr 12 02:03:18 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'resources' on Instance uuid c712f2db-72cb-4136-a719-56057d82fff6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-213236224',display_name='tempest-ServerActionsTestJSON-server-1476053452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-213236224',id=2,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-x7fh0fil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:00:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=c712f2db-72cb-4136-a719-56057d82fff6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "address": "fa:16:3e:f9:ed:df", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap365b7a91-79", "ovs_interfaceid": "365b7a91-793f-4aaf-af62-4e1c45d300e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_vif [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap365b7a91-79, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:03:18 user nova-compute[82184]: INFO os_vif [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:ed:df,bridge_name='br-int',has_traffic_filtering=True,id=365b7a91-793f-4aaf-af62-4e1c45d300e8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap365b7a91-79')
Apr 12 02:03:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAGdQMby', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:03:18 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7248d9a4-09b2-4adc-bea3-cbbdb9acbb0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:03:18 user nova-compute[82184]: No targets found.
Apr 12 02:03:18 user nova-compute[82184]: iSNS:
Apr 12 02:03:18 user nova-compute[82184]: No targets found.
Apr 12 02:03:18 user nova-compute[82184]: STATIC:
Apr 12 02:03:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f
Apr 12 02:03:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:03:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:03:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a
Apr 12 02:03:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:03:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:03:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56
Apr 12 02:03:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:03:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:03:18 user nova-compute[82184]: FIRMWARE:
Apr 12 02:03:18 user nova-compute[82184]: No targets found.
Apr 12 02:03:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:03:18 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:03:18 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3b9528-6d04-4498-b25a-4006a9a6f6f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc147363-bafc-4ee8-8ff2-c284409dde2d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:03:18 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:03:18 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:03:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:03:18 user nova-compute[82184]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a (non-flash)
Apr 12 02:03:18 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:03:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a8189bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ba89e-b9ff-4dc1-a6cd-df161876c1c7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8fc851-6a4d-4671-84e4-765be14c443c]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba7c71-8b33-4bfa-88fc-964ffc2b5466]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cfbb23-9ed3-4260-83a9-0d9135c4fa21]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd72e96a-4c01-4e83-854f-aa31d538e54e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab4d628-79ac-41d0-81f2-7d64096be38f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260]
Apr 12 02:03:18 user nova-compute[82184]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a, portal: 172.16.0.220,3260] successful.
Apr 12 02:03:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c40d13a-f773-494b-be5c-b559dfc5686a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[65068ded-f5ac-4427-8a7b-e72e9258abba]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== disconnect_volume: return (287ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:03:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Deleting instance files /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6_del
Apr 12 02:03:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Deletion of /opt/stack/data/nova/instances/c712f2db-72cb-4136-a719-56057d82fff6_del complete
Apr 12 02:03:18 user nova-compute[82184]: INFO nova.compute.manager [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 12 02:03:18 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:03:18 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:03:19 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:03:19 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Took 1.02 seconds to deallocate network for instance.
Apr 12 02:03:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-19da49c7-71ba-4cfe-8520-65fe837cbf44 req-fadcb432-534f-4cec-996c-4e67b5ebf0f2 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-deleted-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:19 user nova-compute[82184]: INFO nova.compute.manager [req-19da49c7-71ba-4cfe-8520-65fe837cbf44 req-fadcb432-534f-4cec-996c-4e67b5ebf0f2 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Neutron deleted interface 365b7a91-793f-4aaf-af62-4e1c45d300e8; detaching it from the instance and deleting it from the info cache
Apr 12 02:03:19 user nova-compute[82184]: DEBUG nova.network.neutron [req-19da49c7-71ba-4cfe-8520-65fe837cbf44 req-fadcb432-534f-4cec-996c-4e67b5ebf0f2 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:03:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-19da49c7-71ba-4cfe-8520-65fe837cbf44 req-fadcb432-534f-4cec-996c-4e67b5ebf0f2 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Detach interface failed, port_id=365b7a91-793f-4aaf-af62-4e1c45d300e8, reason: Instance c712f2db-72cb-4136-a719-56057d82fff6 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 02:03:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-5d437e3f-36c1-4379-b19c-68b0fb285ca2 req-4705c6cc-75c5-4c0e-bef7-829284f3b850 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5d437e3f-36c1-4379-b19c-68b0fb285ca2 req-4705c6cc-75c5-4c0e-bef7-829284f3b850 service nova] Acquiring lock "c712f2db-72cb-4136-a719-56057d82fff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5d437e3f-36c1-4379-b19c-68b0fb285ca2 req-4705c6cc-75c5-4c0e-bef7-829284f3b850 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5d437e3f-36c1-4379-b19c-68b0fb285ca2 req-4705c6cc-75c5-4c0e-bef7-829284f3b850 service nova] Lock "c712f2db-72cb-4136-a719-56057d82fff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-5d437e3f-36c1-4379-b19c-68b0fb285ca2 req-4705c6cc-75c5-4c0e-bef7-829284f3b850 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] No waiting events found dispatching network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:03:19 user nova-compute[82184]: WARNING nova.compute.manager [req-5d437e3f-36c1-4379-b19c-68b0fb285ca2 req-4705c6cc-75c5-4c0e-bef7-829284f3b850 service nova] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Received unexpected event network-vif-plugged-365b7a91-793f-4aaf-af62-4e1c45d300e8 for instance with vm_state active and task_state deleting.
Apr 12 02:03:20 user nova-compute[82184]: INFO nova.compute.manager [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Took 0.89 seconds to detach 1 volumes for instance.
Apr 12 02:03:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:20 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:03:20 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:03:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:20 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Deleted allocations for instance c712f2db-72cb-4136-a719-56057d82fff6
Apr 12 02:03:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a848fdf1-9f84-43e0-b855-9188e5e345c5 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "c712f2db-72cb-4136-a719-56057d82fff6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.592s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:27 user nova-compute[82184]: INFO nova.compute.manager [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Unshelving
Apr 12 02:03:27 user nova-compute[82184]: INFO nova.virt.block_device [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Booting with volume 11d89fd1-2c63-48c0-8341-1af121bc4cc7 at /dev/vda
Apr 12 02:03:27 user nova-compute[82184]: DEBUG os_brick.utils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7297f7e-d1c6-4438-aa2c-110e538c16ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb05b484-6848-44d1-80ca-aa4edb6ca81b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e6271a-d32b-48cb-ae08-cf992b7bd6fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef9bbb8-0100-4dde-a767-d74a9098ebb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:03:27 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:03:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dbf1c1-74dc-4aba-8fad-d3d572984f52]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG os_brick.utils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:03:27 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating existing volume attachment record: 05299a76-572a-411d-98eb-f79354281bdd {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:03:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:31 user nova-compute[82184]: DEBUG nova.objects.instance [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lazy-loading 'pci_requests' on Instance uuid b8c39c58-73b3-4574-9fcf-0c5901a81aa0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:03:31 user nova-compute[82184]: DEBUG nova.objects.instance [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lazy-loading 'numa_topology' on Instance uuid b8c39c58-73b3-4574-9fcf-0c5901a81aa0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:03:32 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:03:32 user nova-compute[82184]: INFO nova.compute.claims [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Claim successful on node user
Apr 12 02:03:32 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:03:32 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:03:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:32 user nova-compute[82184]: INFO nova.network.neutron [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating port b64bd49d-20d0-4f9d-b07c-078a55b0542f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquired lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.network.neutron [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-f4af25a6-f324-44c5-a831-568f8e080510 req-c11d30f6-0230-4160-a1dc-3ad3f7c74991 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-changed-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-f4af25a6-f324-44c5-a831-568f8e080510 req-c11d30f6-0230-4160-a1dc-3ad3f7c74991 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Refreshing instance network info cache due to event network-changed-b64bd49d-20d0-4f9d-b07c-078a55b0542f. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f4af25a6-f324-44c5-a831-568f8e080510 req-c11d30f6-0230-4160-a1dc-3ad3f7c74991 service nova] Acquiring lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681264998.2560723, c712f2db-72cb-4136-a719-56057d82fff6 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:03:33 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: c712f2db-72cb-4136-a719-56057d82fff6] VM Stopped (Lifecycle Event)
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1cfa202e-d361-42cd-b9e6-e88c167137ef None None] [instance: c712f2db-72cb-4136-a719-56057d82fff6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.network.neutron [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating instance_info_cache with network_info: [{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Releasing lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:03:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Creating image(s)
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Ensure instance console log exists: /opt/stack/data/nova/instances/b8c39c58-73b3-4574-9fcf-0c5901a81aa0/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Start _get_guest_xml network_info=[{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '05299a76-572a-411d-98eb-f79354281bdd', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEchyUgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8c39c58-73b3-4574-9fcf-0c5901a81aa0', 'attached_at': '', 'detached_at': '', 'volume_id': '11d89fd1-2c63-48c0-8341-1af121bc4cc7', 'serial': '11d89fd1-2c63-48c0-8341-1af121bc4cc7'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f4af25a6-f324-44c5-a831-568f8e080510 req-c11d30f6-0230-4160-a1dc-3ad3f7c74991 service nova] Acquired lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.network.neutron [req-f4af25a6-f324-44c5-a831-568f8e080510 req-c11d30f6-0230-4160-a1dc-3ad3f7c74991 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Refreshing network info cache for port b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:03:33 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:03:33 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8c39c58-73b3-4574-9fcf-0c5901a81aa0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEchyUgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:03:33 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:03:33 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:03:33 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2bc66c-c5ff-4927-9d37-9e99b9f6303c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:03:33 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04671924-7be9-4cdb-9a5c-7f5fb48c85f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7] added
Apr 12 02:03:33 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f47b6bd-6719-4b87-bf8e-98e0d6d22062]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d3e65c-cc59-411a-a683-24b7dc9e082a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEchyUgX {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AEchyUgX" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3930cc94-c8ef-4cdb-a9ef-7d287bf6d166]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AEchyUgX'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4615ee-7af0-4b50-8a0e-42cc99273d92]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a0d12b-410d-4dc6-9be6-1df7d5ac1b1c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:03:33 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:03:33 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:03:33 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:03:33 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[261a05d2-6a2e-47b6-80a5-aafa0ad054e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260]
Apr 12 02:03:33 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260] successful.
Apr 12 02:03:33 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9024d553-5b02-4deb-9e7f-54ed910d9d47]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[58007560-c147-4ff3-8c8d-fa9067745ce4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:03:33 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:03:33 user nova-compute[82184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:03:33 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:03:33 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:03:33 user nova-compute[82184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:03:33 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:03:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[882325b6-4edd-4ea7-92cf-fb48973b398d]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEchyUgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG nova.network.neutron [req-f4af25a6-f324-44c5-a831-568f8e080510 req-c11d30f6-0230-4160-a1dc-3ad3f7c74991 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updated VIF entry in instance network info cache for port b64bd49d-20d0-4f9d-b07c-078a55b0542f. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG nova.network.neutron [req-f4af25a6-f324-44c5-a831-568f8e080510 req-c11d30f6-0230-4160-a1dc-3ad3f7c74991 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating instance_info_cache with network_info: [{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f4af25a6-f324-44c5-a831-568f8e080510 req-c11d30f6-0230-4160-a1dc-3ad3f7c74991 service nova] Releasing lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-e1f8f4c6-d72f-42b3-9176-8d1eee0a086b req-27af9730-0301-4ec5-b929-bbb3da1d56f2 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received event network-changed-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-e1f8f4c6-d72f-42b3-9176-8d1eee0a086b req-27af9730-0301-4ec5-b929-bbb3da1d56f2 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Refreshing instance network info cache due to event network-changed-bee74d19-41d7-4f0a-8ead-0f835edb08f5. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e1f8f4c6-d72f-42b3-9176-8d1eee0a086b req-27af9730-0301-4ec5-b929-bbb3da1d56f2 service nova] Acquiring lock "refresh_cache-0fa3c7e6-a1a9-490e-ae02-8b1359736485" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e1f8f4c6-d72f-42b3-9176-8d1eee0a086b req-27af9730-0301-4ec5-b929-bbb3da1d56f2 service nova] Acquired lock "refresh_cache-0fa3c7e6-a1a9-490e-ae02-8b1359736485" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:03:34 user nova-compute[82184]: DEBUG nova.network.neutron [req-e1f8f4c6-d72f-42b3-9176-8d1eee0a086b req-27af9730-0301-4ec5-b929-bbb3da1d56f2 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Refreshing network info cache for port bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23734336161353763', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734336161353763', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-662581423',display_name='tempest-TestShelveInstance-server-662581423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-662581423',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-269156000',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='97353e0d7e084a1095d6ae46416d5660',ramdisk_id='',reservation_id='r-68gx34k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1070508789',owner_user_name='tempest-TestShelveInstance-1070508789-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:03:27Z,user_data=None,user_id='5108c5bde1e249a2934f3e47496b1027',uuid=b8c39c58-73b3-4574-9fcf-0c5901a81aa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converting VIF {"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.objects.instance [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lazy-loading 'pci_devices' on Instance uuid b8c39c58-73b3-4574-9fcf-0c5901a81aa0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:03:35 user nova-compute[82184]:   <uuid>b8c39c58-73b3-4574-9fcf-0c5901a81aa0</uuid>
Apr 12 02:03:35 user nova-compute[82184]:   <name>instance-00000017</name>
Apr 12 02:03:35 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:03:35 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:03:35 user nova-compute[82184]:   <metadata>
Apr 12 02:03:35 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:03:35 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:03:35 user nova-compute[82184]:       <nova:name>tempest-TestShelveInstance-server-662581423</nova:name>
Apr 12 02:03:35 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:03:33</nova:creationTime>
Apr 12 02:03:35 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:03:35 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:03:35 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:03:35 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:03:35 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:03:35 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:03:35 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:03:35 user nova-compute[82184]:       <nova:owner>
Apr 12 02:03:35 user nova-compute[82184]:         <nova:user uuid="5108c5bde1e249a2934f3e47496b1027">tempest-TestShelveInstance-1070508789-project-member</nova:user>
Apr 12 02:03:35 user nova-compute[82184]:         <nova:project uuid="97353e0d7e084a1095d6ae46416d5660">tempest-TestShelveInstance-1070508789</nova:project>
Apr 12 02:03:35 user nova-compute[82184]:       </nova:owner>
Apr 12 02:03:35 user nova-compute[82184]:       <nova:ports>
Apr 12 02:03:35 user nova-compute[82184]:         <nova:port uuid="b64bd49d-20d0-4f9d-b07c-078a55b0542f">
Apr 12 02:03:35 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 02:03:35 user nova-compute[82184]:         </nova:port>
Apr 12 02:03:35 user nova-compute[82184]:       </nova:ports>
Apr 12 02:03:35 user nova-compute[82184]:     </nova:instance>
Apr 12 02:03:35 user nova-compute[82184]:   </metadata>
Apr 12 02:03:35 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:03:35 user nova-compute[82184]:     <system>
Apr 12 02:03:35 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:03:35 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:03:35 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:03:35 user nova-compute[82184]:       <entry name="serial">b8c39c58-73b3-4574-9fcf-0c5901a81aa0</entry>
Apr 12 02:03:35 user nova-compute[82184]:       <entry name="uuid">b8c39c58-73b3-4574-9fcf-0c5901a81aa0</entry>
Apr 12 02:03:35 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:03:35 user nova-compute[82184]:     </system>
Apr 12 02:03:35 user nova-compute[82184]:   </sysinfo>
Apr 12 02:03:35 user nova-compute[82184]:   <os>
Apr 12 02:03:35 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:03:35 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:03:35 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:03:35 user nova-compute[82184]:   </os>
Apr 12 02:03:35 user nova-compute[82184]:   <features>
Apr 12 02:03:35 user nova-compute[82184]:     <acpi/>
Apr 12 02:03:35 user nova-compute[82184]:     <apic/>
Apr 12 02:03:35 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:03:35 user nova-compute[82184]:   </features>
Apr 12 02:03:35 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:03:35 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:03:35 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:03:35 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:03:35 user nova-compute[82184]:   </clock>
Apr 12 02:03:35 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:03:35 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:03:35 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:03:35 user nova-compute[82184]:   </cpu>
Apr 12 02:03:35 user nova-compute[82184]:   <devices>
Apr 12 02:03:35 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:03:35 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:03:35 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 02:03:35 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:03:35 user nova-compute[82184]:       <serial>11d89fd1-2c63-48c0-8341-1af121bc4cc7</serial>
Apr 12 02:03:35 user nova-compute[82184]:     </disk>
Apr 12 02:03:35 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:03:35 user nova-compute[82184]:       <mac address="fa:16:3e:13:82:50"/>
Apr 12 02:03:35 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:03:35 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:03:35 user nova-compute[82184]:       <target dev="tapb64bd49d-20"/>
Apr 12 02:03:35 user nova-compute[82184]:     </interface>
Apr 12 02:03:35 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:03:35 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/b8c39c58-73b3-4574-9fcf-0c5901a81aa0/console.log" append="off"/>
Apr 12 02:03:35 user nova-compute[82184]:     </serial>
Apr 12 02:03:35 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:03:35 user nova-compute[82184]:     <video>
Apr 12 02:03:35 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:03:35 user nova-compute[82184]:     </video>
Apr 12 02:03:35 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:03:35 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:03:35 user nova-compute[82184]:     </rng>
Apr 12 02:03:35 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:03:35 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:03:35 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:03:35 user nova-compute[82184]:     </memballoon>
Apr 12 02:03:35 user nova-compute[82184]:   </devices>
Apr 12 02:03:35 user nova-compute[82184]: </domain>
Apr 12 02:03:35 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-662581423',display_name='tempest-TestShelveInstance-server-662581423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-662581423',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-269156000',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:59:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='97353e0d7e084a1095d6ae46416d5660',ramdisk_id='',reservation_id='r-68gx34k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1070508789',owner_user_name='tempest-TestShelveInstance-1070508789-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:03:27Z,user_data=None,user_id='5108c5bde1e249a2934f3e47496b1027',uuid=b8c39c58-73b3-4574-9fcf-0c5901a81aa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converting VIF {"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG os_vif [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb64bd49d-20, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb64bd49d-20, col_values=(('external_ids', {'iface-id': 'b64bd49d-20d0-4f9d-b07c-078a55b0542f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:82:50', 'vm-uuid': 'b8c39c58-73b3-4574-9fcf-0c5901a81aa0'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:35 user nova-compute[82184]: INFO os_vif [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20')
Apr 12 02:03:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:35 user nova-compute[82184]: INFO nova.compute.manager [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Terminating instance
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] No VIF found with MAC fa:16:3e:13:82:50, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-ab27b787-0db3-4ff7-b4e2-af32197d080f req-ab6828dd-0e9f-4507-ad69-96d857072f7b service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received event network-vif-unplugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ab27b787-0db3-4ff7-b4e2-af32197d080f req-ab6828dd-0e9f-4507-ad69-96d857072f7b service nova] Acquiring lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ab27b787-0db3-4ff7-b4e2-af32197d080f req-ab6828dd-0e9f-4507-ad69-96d857072f7b service nova] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ab27b787-0db3-4ff7-b4e2-af32197d080f req-ab6828dd-0e9f-4507-ad69-96d857072f7b service nova] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-ab27b787-0db3-4ff7-b4e2-af32197d080f req-ab6828dd-0e9f-4507-ad69-96d857072f7b service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] No waiting events found dispatching network-vif-unplugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:03:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-ab27b787-0db3-4ff7-b4e2-af32197d080f req-ab6828dd-0e9f-4507-ad69-96d857072f7b service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received event network-vif-unplugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG nova.network.neutron [req-e1f8f4c6-d72f-42b3-9176-8d1eee0a086b req-27af9730-0301-4ec5-b929-bbb3da1d56f2 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Updated VIF entry in instance network info cache for port bee74d19-41d7-4f0a-8ead-0f835edb08f5. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG nova.network.neutron [req-e1f8f4c6-d72f-42b3-9176-8d1eee0a086b req-27af9730-0301-4ec5-b929-bbb3da1d56f2 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Updating instance_info_cache with network_info: [{"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e1f8f4c6-d72f-42b3-9176-8d1eee0a086b req-27af9730-0301-4ec5-b929-bbb3da1d56f2 service nova] Releasing lock "refresh_cache-0fa3c7e6-a1a9-490e-ae02-8b1359736485" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:36 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Instance destroyed successfully.
Apr 12 02:03:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'resources' on Instance uuid 0fa3c7e6-a1a9-490e-ae02-8b1359736485 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1914850466',display_name='tempest-AttachVolumeNegativeTest-server-1914850466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1914850466',id=26,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVpgpX5yJOQZe/kmK27+zCnCpAv8hp5n1Z5z/6JfKL7n0TJHIZd3wBN6t2NstleJwX5uAbZaPwEfvUa6lQVO8DYrciFuHQtC2fskesOJygGb1X0B1D27t35FhlYWtvnlw==',key_name='tempest-keypair-1196686774',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:01:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-n82zija5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:01:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=0fa3c7e6-a1a9-490e-ae02-8b1359736485,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "address": "fa:16:3e:de:3d:b3", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee74d19-41", "ovs_interfaceid": "bee74d19-41d7-4f0a-8ead-0f835edb08f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3d:b3,bridge_name='br-int',has_traffic_filtering=True,id=bee74d19-41d7-4f0a-8ead-0f835edb08f5,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee74d19-41') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG os_vif [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3d:b3,bridge_name='br-int',has_traffic_filtering=True,id=bee74d19-41d7-4f0a-8ead-0f835edb08f5,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee74d19-41') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbee74d19-41, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:36 user nova-compute[82184]: INFO os_vif [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3d:b3,bridge_name='br-int',has_traffic_filtering=True,id=bee74d19-41d7-4f0a-8ead-0f835edb08f5,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee74d19-41')
Apr 12 02:03:36 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Deleting instance files /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485_del
Apr 12 02:03:36 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Deletion of /opt/stack/data/nova/instances/0fa3c7e6-a1a9-490e-ae02-8b1359736485_del complete
Apr 12 02:03:36 user nova-compute[82184]: INFO nova.compute.manager [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Took 1.43 seconds to destroy the instance on the hypervisor.
Apr 12 02:03:36 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e0de537-d425-49b6-9afa-31db03ef7552 req-ee03ae3f-86f8-4076-b5d9-a2a938e182ba service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e0de537-d425-49b6-9afa-31db03ef7552 req-ee03ae3f-86f8-4076-b5d9-a2a938e182ba service nova] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e0de537-d425-49b6-9afa-31db03ef7552 req-ee03ae3f-86f8-4076-b5d9-a2a938e182ba service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2e0de537-d425-49b6-9afa-31db03ef7552 req-ee03ae3f-86f8-4076-b5d9-a2a938e182ba service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-2e0de537-d425-49b6-9afa-31db03ef7552 req-ee03ae3f-86f8-4076-b5d9-a2a938e182ba service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] No waiting events found dispatching network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:03:37 user nova-compute[82184]: WARNING nova.compute.manager [req-2e0de537-d425-49b6-9afa-31db03ef7552 req-ee03ae3f-86f8-4076-b5d9-a2a938e182ba service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received unexpected event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 02:03:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:03:37 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Took 1.03 seconds to deallocate network for instance.
Apr 12 02:03:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-8b1b1a03-3236-4dc1-9da0-7bc159eaa311 req-88e25041-3755-4297-ab3b-8dca5bb1adf9 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received event network-vif-plugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8b1b1a03-3236-4dc1-9da0-7bc159eaa311 req-88e25041-3755-4297-ab3b-8dca5bb1adf9 service nova] Acquiring lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8b1b1a03-3236-4dc1-9da0-7bc159eaa311 req-88e25041-3755-4297-ab3b-8dca5bb1adf9 service nova] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8b1b1a03-3236-4dc1-9da0-7bc159eaa311 req-88e25041-3755-4297-ab3b-8dca5bb1adf9 service nova] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-8b1b1a03-3236-4dc1-9da0-7bc159eaa311 req-88e25041-3755-4297-ab3b-8dca5bb1adf9 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] No waiting events found dispatching network-vif-plugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:03:37 user nova-compute[82184]: WARNING nova.compute.manager [req-8b1b1a03-3236-4dc1-9da0-7bc159eaa311 req-88e25041-3755-4297-ab3b-8dca5bb1adf9 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received unexpected event network-vif-plugged-bee74d19-41d7-4f0a-8ead-0f835edb08f5 for instance with vm_state active and task_state deleting.
Apr 12 02:03:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-8b1b1a03-3236-4dc1-9da0-7bc159eaa311 req-88e25041-3755-4297-ab3b-8dca5bb1adf9 service nova] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Received event network-vif-deleted-bee74d19-41d7-4f0a-8ead-0f835edb08f5 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:03:37 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:03:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:38 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Deleted allocations for instance 0fa3c7e6-a1a9-490e-ae02-8b1359736485
Apr 12 02:03:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0ad3fb24-1598-4504-8931-4549f1d318e1 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "0fa3c7e6-a1a9-490e-ae02-8b1359736485" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.983s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265019.1073422, b8c39c58-73b3-4574-9fcf-0c5901a81aa0 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:03:39 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] VM Resumed (Lifecycle Event)
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:03:39 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Instance spawned successfully.
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:03:39 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265019.1112618, b8c39c58-73b3-4574-9fcf-0c5901a81aa0 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:03:39 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] VM Started (Lifecycle Event)
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-89b36eeb-1814-42c7-8d4a-b2fb4d92dd11 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.020s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-fb5e1a1f-6624-49f6-a7c5-f211d1e18936 req-44de4984-0f47-44eb-a353-fd4bb9cb5022 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fb5e1a1f-6624-49f6-a7c5-f211d1e18936 req-44de4984-0f47-44eb-a353-fd4bb9cb5022 service nova] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fb5e1a1f-6624-49f6-a7c5-f211d1e18936 req-44de4984-0f47-44eb-a353-fd4bb9cb5022 service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fb5e1a1f-6624-49f6-a7c5-f211d1e18936 req-44de4984-0f47-44eb-a353-fd4bb9cb5022 service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-fb5e1a1f-6624-49f6-a7c5-f211d1e18936 req-44de4984-0f47-44eb-a353-fd4bb9cb5022 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] No waiting events found dispatching network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:03:39 user nova-compute[82184]: WARNING nova.compute.manager [req-fb5e1a1f-6624-49f6-a7c5-f211d1e18936 req-44de4984-0f47-44eb-a353-fd4bb9cb5022 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received unexpected event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f for instance with vm_state active and task_state None.
Apr 12 02:03:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:03:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:03:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:03:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:03:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:03:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updating instance_info_cache with network_info: [{"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265016.5247643, 0fa3c7e6-a1a9-490e-ae02-8b1359736485 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:03:51 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] VM Stopped (Lifecycle Event)
Apr 12 02:03:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-275d188d-87b3-425c-bc1a-fd195c0e2116 None None] [instance: 0fa3c7e6-a1a9-490e-ae02-8b1359736485] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:03:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:03:52 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:03:52 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:03:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8043MB free_disk=26.454463958740234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 84b4902c-24d9-4e96-b51f-e93e913aa681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 101410fb-7682-46d8-baf1-18fcebf81cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:03:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance b8c39c58-73b3-4574-9fcf-0c5901a81aa0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:03:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:03:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:03:53 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:03:53 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:03:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:03:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:03:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:03:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:03:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:03:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:03:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:03:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:03:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:03:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:03:59 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:04:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-4746890a-46c1-4d6a-b9a2-34ec2b7b1f42 req-0bab2497-0855-4721-ba12-376565b71f52 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-changed-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:04:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-4746890a-46c1-4d6a-b9a2-34ec2b7b1f42 req-0bab2497-0855-4721-ba12-376565b71f52 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Refreshing instance network info cache due to event network-changed-b1709cc0-5e25-4f89-aa42-8bc0a424adc1. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:04:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4746890a-46c1-4d6a-b9a2-34ec2b7b1f42 req-0bab2497-0855-4721-ba12-376565b71f52 service nova] Acquiring lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:04:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4746890a-46c1-4d6a-b9a2-34ec2b7b1f42 req-0bab2497-0855-4721-ba12-376565b71f52 service nova] Acquired lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:04:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-4746890a-46c1-4d6a-b9a2-34ec2b7b1f42 req-0bab2497-0855-4721-ba12-376565b71f52 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Refreshing network info cache for port b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:04:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:00 user nova-compute[82184]: INFO nova.compute.manager [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Detaching volume f6f462d6-7d7c-4843-97c3-d0ded790997f
Apr 12 02:04:01 user nova-compute[82184]: INFO nova.virt.block_device [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Attempting to driver detach volume f6f462d6-7d7c-4843-97c3-d0ded790997f from mountpoint /dev/vdb
Apr 12 02:04:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Attempting to detach device vdb from instance 84b4902c-24d9-4e96-b51f-e93e913aa681 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:04:01 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:04:01 user nova-compute[82184]:   <source dev="/dev/sde"/>
Apr 12 02:04:01 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:04:01 user nova-compute[82184]:   <serial>f6f462d6-7d7c-4843-97c3-d0ded790997f</serial>
Apr 12 02:04:01 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:04:01 user nova-compute[82184]: </disk>
Apr 12 02:04:01 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:04:01 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Successfully detached device vdb from instance 84b4902c-24d9-4e96-b51f-e93e913aa681 from the persistent domain config.
Apr 12 02:04:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84b4902c-24d9-4e96-b51f-e93e913aa681 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:04:01 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:04:01 user nova-compute[82184]:   <source dev="/dev/sde"/>
Apr 12 02:04:01 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:04:01 user nova-compute[82184]:   <serial>f6f462d6-7d7c-4843-97c3-d0ded790997f</serial>
Apr 12 02:04:01 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:04:01 user nova-compute[82184]: </disk>
Apr 12 02:04:01 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-4746890a-46c1-4d6a-b9a2-34ec2b7b1f42 req-0bab2497-0855-4721-ba12-376565b71f52 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updated VIF entry in instance network info cache for port b1709cc0-5e25-4f89-aa42-8bc0a424adc1. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-4746890a-46c1-4d6a-b9a2-34ec2b7b1f42 req-0bab2497-0855-4721-ba12-376565b71f52 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updating instance_info_cache with network_info: [{"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4746890a-46c1-4d6a-b9a2-34ec2b7b1f42 req-0bab2497-0855-4721-ba12-376565b71f52 service nova] Releasing lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681265041.5323024, 84b4902c-24d9-4e96-b51f-e93e913aa681 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:04:01 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Successfully detached device vdb from instance 84b4902c-24d9-4e96-b51f-e93e913aa681 from the live domain config.
Apr 12 02:04:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NRnCtxap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:04:01 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd7ccba-0634-44af-be03-7c3e30ab0676]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:04:01 user nova-compute[82184]: No targets found.
Apr 12 02:04:01 user nova-compute[82184]: iSNS:
Apr 12 02:04:01 user nova-compute[82184]: No targets found.
Apr 12 02:04:01 user nova-compute[82184]: STATIC:
Apr 12 02:04:01 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f
Apr 12 02:04:01 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:04:01 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:04:01 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7
Apr 12 02:04:01 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:04:01 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:04:01 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56
Apr 12 02:04:01 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:04:01 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:04:01 user nova-compute[82184]: FIRMWARE:
Apr 12 02:04:01 user nova-compute[82184]: No targets found.
Apr 12 02:04:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:04:01 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:04:01 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3dceb5-d698-4e6b-a857-e7a65ee9d15c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24528c53-b84d-48ce-b114-306afdfe253c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:04:01 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:04:01 user nova-compute[82184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:04:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f (non-flash)
Apr 12 02:04:01 user nova-compute[82184]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:04:01 user nova-compute[82184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:04:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26af2c30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f'): ({'sde'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Removing single pathed devices sde {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a29187-4d6c-40fb-96a2-09789208f6fa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[51882183-b7e6-4ddd-a018-e4d84f123fbb]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Flushing IO for device /dev/sde {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe68a741-30da-4e67-bb0d-f9693cee0452]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9bda7e-d060-4e30-a5e4-3b1de0600afa]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] SCSI volumes sde have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e34c9b-a5e7-48ec-9d65-6894eede7ba4]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7bae74-bb21-4d56-9301-74c604500106]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f, portal: 172.16.0.220,3260]
Apr 12 02:04:01 user nova-compute[82184]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f, portal: 172.16.0.220,3260] successful.
Apr 12 02:04:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6f462d6-7d7c-4843-97c3-d0ded790997f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3cd968-8389-4c35-acff-5b3c2355f9ba]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] <== disconnect_volume: return (362ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:04:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:04:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-fd26b85b-8938-4dec-b0cf-4c03c77c58cd req-e63e0360-74e7-4223-bc0a-a8c9bc677f32 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-changed-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:04:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-fd26b85b-8938-4dec-b0cf-4c03c77c58cd req-e63e0360-74e7-4223-bc0a-a8c9bc677f32 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Refreshing instance network info cache due to event network-changed-b1709cc0-5e25-4f89-aa42-8bc0a424adc1. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:04:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fd26b85b-8938-4dec-b0cf-4c03c77c58cd req-e63e0360-74e7-4223-bc0a-a8c9bc677f32 service nova] Acquiring lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:04:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fd26b85b-8938-4dec-b0cf-4c03c77c58cd req-e63e0360-74e7-4223-bc0a-a8c9bc677f32 service nova] Acquired lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:04:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-fd26b85b-8938-4dec-b0cf-4c03c77c58cd req-e63e0360-74e7-4223-bc0a-a8c9bc677f32 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Refreshing network info cache for port b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:04:02 user nova-compute[82184]: DEBUG nova.objects.instance [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'flavor' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:04:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-85d7edce-1b34-4ae7-844c-7c4a33cd7752 tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.871s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:03 user nova-compute[82184]: DEBUG nova.network.neutron [req-fd26b85b-8938-4dec-b0cf-4c03c77c58cd req-e63e0360-74e7-4223-bc0a-a8c9bc677f32 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updated VIF entry in instance network info cache for port b1709cc0-5e25-4f89-aa42-8bc0a424adc1. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:04:03 user nova-compute[82184]: DEBUG nova.network.neutron [req-fd26b85b-8938-4dec-b0cf-4c03c77c58cd req-e63e0360-74e7-4223-bc0a-a8c9bc677f32 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updating instance_info_cache with network_info: [{"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:04:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fd26b85b-8938-4dec-b0cf-4c03c77c58cd req-e63e0360-74e7-4223-bc0a-a8c9bc677f32 service nova] Releasing lock "refresh_cache-84b4902c-24d9-4e96-b51f-e93e913aa681" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:04:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "1a3c868f-3a4c-430e-8009-7a855e832f82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:04:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:04:09 user nova-compute[82184]: INFO nova.compute.claims [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Claim successful on node user
Apr 12 02:04:10 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:04:10 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:04:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG nova.policy [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8e8b9f0307b4d3fb54d89962798026b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117589cba4a54dd581f4ec5c26b4cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:04:10 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Creating image(s)
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "/opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "/opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk 1073741824" returned: 0 in 0.051s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.174s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:04:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Cannot resize image /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'migration_context' on Instance uuid 1a3c868f-3a4c-430e-8009-7a855e832f82 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Ensure instance console log exists: /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Successfully created port: 915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Successfully updated port: 915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG nova.compute.manager [req-0cc10c10-711e-4cb2-baed-56f6bf76ac96 req-fbab2281-0632-45a8-9cba-d67bd8f2301a service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received event network-changed-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG nova.compute.manager [req-0cc10c10-711e-4cb2-baed-56f6bf76ac96 req-fbab2281-0632-45a8-9cba-d67bd8f2301a service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Refreshing instance network info cache due to event network-changed-915517f3-521b-4d3a-a7c0-841b64ac50a8. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0cc10c10-711e-4cb2-baed-56f6bf76ac96 req-fbab2281-0632-45a8-9cba-d67bd8f2301a service nova] Acquiring lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:04:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updating instance_info_cache with network_info: [{"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Instance network_info: |[{"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0cc10c10-711e-4cb2-baed-56f6bf76ac96 req-fbab2281-0632-45a8-9cba-d67bd8f2301a service nova] Acquired lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.network.neutron [req-0cc10c10-711e-4cb2-baed-56f6bf76ac96 req-fbab2281-0632-45a8-9cba-d67bd8f2301a service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Refreshing network info cache for port 915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Start _get_guest_xml network_info=[{"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:04:12 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:04:12 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-312717327',display_name='tempest-ServerActionsTestJSON-server-312717327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-312717327',id=28,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-b1jhexcc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:04:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=1a3c868f-3a4c-430e-8009-7a855e832f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=915517f3-521b-4d3a-a7c0-841b64ac50a8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap915517f3-52') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a3c868f-3a4c-430e-8009-7a855e832f82 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:04:12 user nova-compute[82184]:   <uuid>1a3c868f-3a4c-430e-8009-7a855e832f82</uuid>
Apr 12 02:04:12 user nova-compute[82184]:   <name>instance-0000001c</name>
Apr 12 02:04:12 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:04:12 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:04:12 user nova-compute[82184]:   <metadata>
Apr 12 02:04:12 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:04:12 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:04:12 user nova-compute[82184]:       <nova:name>tempest-ServerActionsTestJSON-server-312717327</nova:name>
Apr 12 02:04:12 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:04:12</nova:creationTime>
Apr 12 02:04:12 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:04:12 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:04:12 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:04:12 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:04:12 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:04:12 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:04:12 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:04:12 user nova-compute[82184]:       <nova:owner>
Apr 12 02:04:12 user nova-compute[82184]:         <nova:user uuid="e8e8b9f0307b4d3fb54d89962798026b">tempest-ServerActionsTestJSON-1409832124-project-member</nova:user>
Apr 12 02:04:12 user nova-compute[82184]:         <nova:project uuid="117589cba4a54dd581f4ec5c26b4cd2a">tempest-ServerActionsTestJSON-1409832124</nova:project>
Apr 12 02:04:12 user nova-compute[82184]:       </nova:owner>
Apr 12 02:04:12 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:04:12 user nova-compute[82184]:       <nova:ports>
Apr 12 02:04:12 user nova-compute[82184]:         <nova:port uuid="915517f3-521b-4d3a-a7c0-841b64ac50a8">
Apr 12 02:04:12 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 02:04:12 user nova-compute[82184]:         </nova:port>
Apr 12 02:04:12 user nova-compute[82184]:       </nova:ports>
Apr 12 02:04:12 user nova-compute[82184]:     </nova:instance>
Apr 12 02:04:12 user nova-compute[82184]:   </metadata>
Apr 12 02:04:12 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:04:12 user nova-compute[82184]:     <system>
Apr 12 02:04:12 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:04:12 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:04:12 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:04:12 user nova-compute[82184]:       <entry name="serial">1a3c868f-3a4c-430e-8009-7a855e832f82</entry>
Apr 12 02:04:12 user nova-compute[82184]:       <entry name="uuid">1a3c868f-3a4c-430e-8009-7a855e832f82</entry>
Apr 12 02:04:12 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:04:12 user nova-compute[82184]:     </system>
Apr 12 02:04:12 user nova-compute[82184]:   </sysinfo>
Apr 12 02:04:12 user nova-compute[82184]:   <os>
Apr 12 02:04:12 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:04:12 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:04:12 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:04:12 user nova-compute[82184]:   </os>
Apr 12 02:04:12 user nova-compute[82184]:   <features>
Apr 12 02:04:12 user nova-compute[82184]:     <acpi/>
Apr 12 02:04:12 user nova-compute[82184]:     <apic/>
Apr 12 02:04:12 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:04:12 user nova-compute[82184]:   </features>
Apr 12 02:04:12 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:04:12 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:04:12 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:04:12 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:04:12 user nova-compute[82184]:   </clock>
Apr 12 02:04:12 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:04:12 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:04:12 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:04:12 user nova-compute[82184]:   </cpu>
Apr 12 02:04:12 user nova-compute[82184]:   <devices>
Apr 12 02:04:12 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:04:12 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:04:12 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk"/>
Apr 12 02:04:12 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:04:12 user nova-compute[82184]:     </disk>
Apr 12 02:04:12 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:04:12 user nova-compute[82184]:       <mac address="fa:16:3e:fe:33:b8"/>
Apr 12 02:04:12 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:04:12 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:04:12 user nova-compute[82184]:       <target dev="tap915517f3-52"/>
Apr 12 02:04:12 user nova-compute[82184]:     </interface>
Apr 12 02:04:12 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:04:12 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/console.log" append="off"/>
Apr 12 02:04:12 user nova-compute[82184]:     </serial>
Apr 12 02:04:12 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:04:12 user nova-compute[82184]:     <video>
Apr 12 02:04:12 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:04:12 user nova-compute[82184]:     </video>
Apr 12 02:04:12 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:04:12 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:04:12 user nova-compute[82184]:     </rng>
Apr 12 02:04:12 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:04:12 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:04:12 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:04:12 user nova-compute[82184]:     </memballoon>
Apr 12 02:04:12 user nova-compute[82184]:   </devices>
Apr 12 02:04:12 user nova-compute[82184]: </domain>
Apr 12 02:04:12 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-312717327',display_name='tempest-ServerActionsTestJSON-server-312717327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-312717327',id=28,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-b1jhexcc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:04:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=1a3c868f-3a4c-430e-8009-7a855e832f82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=915517f3-521b-4d3a-a7c0-841b64ac50a8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap915517f3-52') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG os_vif [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=915517f3-521b-4d3a-a7c0-841b64ac50a8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap915517f3-52') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap915517f3-52, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap915517f3-52, col_values=(('external_ids', {'iface-id': '915517f3-521b-4d3a-a7c0-841b64ac50a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:33:b8', 'vm-uuid': '1a3c868f-3a4c-430e-8009-7a855e832f82'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:12 user nova-compute[82184]: INFO os_vif [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=915517f3-521b-4d3a-a7c0-841b64ac50a8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap915517f3-52')
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No VIF found with MAC fa:16:3e:fe:33:b8, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.network.neutron [req-0cc10c10-711e-4cb2-baed-56f6bf76ac96 req-fbab2281-0632-45a8-9cba-d67bd8f2301a service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updated VIF entry in instance network info cache for port 915517f3-521b-4d3a-a7c0-841b64ac50a8. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG nova.network.neutron [req-0cc10c10-711e-4cb2-baed-56f6bf76ac96 req-fbab2281-0632-45a8-9cba-d67bd8f2301a service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updating instance_info_cache with network_info: [{"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:04:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0cc10c10-711e-4cb2-baed-56f6bf76ac96 req-fbab2281-0632-45a8-9cba-d67bd8f2301a service nova] Releasing lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:04:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-6c7508a3-d977-436d-ab8c-36ae11ff4a50 req-cd5c2c13-7119-40bb-bd61-89968ea66fa8 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received event network-vif-plugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:04:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6c7508a3-d977-436d-ab8c-36ae11ff4a50 req-cd5c2c13-7119-40bb-bd61-89968ea66fa8 service nova] Acquiring lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6c7508a3-d977-436d-ab8c-36ae11ff4a50 req-cd5c2c13-7119-40bb-bd61-89968ea66fa8 service nova] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6c7508a3-d977-436d-ab8c-36ae11ff4a50 req-cd5c2c13-7119-40bb-bd61-89968ea66fa8 service nova] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-6c7508a3-d977-436d-ab8c-36ae11ff4a50 req-cd5c2c13-7119-40bb-bd61-89968ea66fa8 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] No waiting events found dispatching network-vif-plugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:04:13 user nova-compute[82184]: WARNING nova.compute.manager [req-6c7508a3-d977-436d-ab8c-36ae11ff4a50 req-cd5c2c13-7119-40bb-bd61-89968ea66fa8 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received unexpected event network-vif-plugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 for instance with vm_state building and task_state spawning.
Apr 12 02:04:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265055.7357647, 1a3c868f-3a4c-430e-8009-7a855e832f82 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:04:15 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] VM Resumed (Lifecycle Event)
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:04:15 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Instance spawned successfully.
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:04:15 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265055.739124, 1a3c868f-3a4c-430e-8009-7a855e832f82 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:04:15 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] VM Started (Lifecycle Event)
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:04:15 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:04:15 user nova-compute[82184]: INFO nova.compute.manager [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Took 5.53 seconds to spawn the instance on the hypervisor.
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-7c53177d-aec1-40cc-b952-926d6ec8767d req-0044e951-a946-4f39-91b5-47f544d85e9a service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received event network-vif-plugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7c53177d-aec1-40cc-b952-926d6ec8767d req-0044e951-a946-4f39-91b5-47f544d85e9a service nova] Acquiring lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7c53177d-aec1-40cc-b952-926d6ec8767d req-0044e951-a946-4f39-91b5-47f544d85e9a service nova] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7c53177d-aec1-40cc-b952-926d6ec8767d req-0044e951-a946-4f39-91b5-47f544d85e9a service nova] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-7c53177d-aec1-40cc-b952-926d6ec8767d req-0044e951-a946-4f39-91b5-47f544d85e9a service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] No waiting events found dispatching network-vif-plugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:04:15 user nova-compute[82184]: WARNING nova.compute.manager [req-7c53177d-aec1-40cc-b952-926d6ec8767d req-0044e951-a946-4f39-91b5-47f544d85e9a service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received unexpected event network-vif-plugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 for instance with vm_state building and task_state spawning.
Apr 12 02:04:15 user nova-compute[82184]: INFO nova.compute.manager [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Took 6.22 seconds to build instance.
Apr 12 02:04:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e84f076f-2387-4e8c-85f3-3ddcc00acf65 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.357s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:26 user nova-compute[82184]: INFO nova.compute.manager [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Detaching volume 7353ae0d-d613-4966-adae-68aa36212f56
Apr 12 02:04:26 user nova-compute[82184]: INFO nova.virt.block_device [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Attempting to driver detach volume 7353ae0d-d613-4966-adae-68aa36212f56 from mountpoint /dev/vdb
Apr 12 02:04:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Attempting to detach device vdb from instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:04:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:04:26 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:04:26 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 02:04:26 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:04:26 user nova-compute[82184]:   <serial>7353ae0d-d613-4966-adae-68aa36212f56</serial>
Apr 12 02:04:26 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:04:26 user nova-compute[82184]: </disk>
Apr 12 02:04:26 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:04:26 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully detached device vdb from instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd from the persistent domain config.
Apr 12 02:04:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:04:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:04:26 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:04:26 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 02:04:26 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:04:26 user nova-compute[82184]:   <serial>7353ae0d-d613-4966-adae-68aa36212f56</serial>
Apr 12 02:04:26 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:04:26 user nova-compute[82184]: </disk>
Apr 12 02:04:26 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681265067.1134286, 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:04:27 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully detached device vdb from instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd from the live domain config.
Apr 12 02:04:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNAjeLTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:04:27 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d046690b-ba60-42b9-8ba1-e49eaaab5f70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:04:27 user nova-compute[82184]: No targets found.
Apr 12 02:04:27 user nova-compute[82184]: iSNS:
Apr 12 02:04:27 user nova-compute[82184]: No targets found.
Apr 12 02:04:27 user nova-compute[82184]: STATIC:
Apr 12 02:04:27 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7
Apr 12 02:04:27 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:04:27 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:04:27 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56
Apr 12 02:04:27 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:04:27 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:04:27 user nova-compute[82184]: FIRMWARE:
Apr 12 02:04:27 user nova-compute[82184]: No targets found.
Apr 12 02:04:27 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:04:27 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:04:27 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc2788e-ab9e-43a1-b4d7-8939e447a73a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a894011-acd0-407f-b492-7ef6957b391b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:04:27 user nova-compute[82184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:04:27 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 (non-flash)
Apr 12 02:04:27 user nova-compute[82184]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:04:27 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b5220ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56'): ({'sdc'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Removing single pathed devices sdc {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd688896-3462-44f9-ac48-51c264aadca7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe25b37c-44c0-43fd-a0c6-a7c4c6b5425c]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flushing IO for device /dev/sdc {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b945902-35bb-427b-8532-538485b419ab]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[68af5ca3-6899-4511-bf26-1f516a93c0d3]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64616a71-66cd-4773-8bb8-455112381694]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f315f6-ee23-4d8b-8bed-316d77784189]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56, portal: 172.16.0.220,3260]
Apr 12 02:04:27 user nova-compute[82184]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56, portal: 172.16.0.220,3260] successful.
Apr 12 02:04:27 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7353ae0d-d613-4966-adae-68aa36212f56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df487f0-e713-4cea-95d2-0149ed055b41]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] <== disconnect_volume: return (345ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:04:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:04:28 user nova-compute[82184]: DEBUG nova.objects.instance [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'flavor' on Instance uuid 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:04:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8635dbc2-4332-45d7-8ad3-41e04c435d2f tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.838s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "2b0bb153-7800-4298-a293-7a2b8cebb194" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:04:47 user nova-compute[82184]: INFO nova.compute.claims [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Claim successful on node user
Apr 12 02:04:47 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:04:47 user nova-compute[82184]: DEBUG nova.network.neutron [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:04:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:04:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:04:47 user nova-compute[82184]: INFO nova.virt.block_device [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Booting with volume snapshot 3e34e9fe-8906-4f7c-a3a9-c39ef07f0267 at /dev/vda
Apr 12 02:04:47 user nova-compute[82184]: DEBUG nova.policy [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d5d81fffb14b1cab84b6160ceb7dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd685278576490480a97cd2bc5e048b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:04:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Successfully created port: 0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Successfully updated port: 0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "refresh_cache-2b0bb153-7800-4298-a293-7a2b8cebb194" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquired lock "refresh_cache-2b0bb153-7800-4298-a293-7a2b8cebb194" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-da33be86-2e17-4d8c-95ed-6f4889c7dac9 req-b5919c50-70d8-42b3-9aa7-df4f87f6ce7d service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Received event network-changed-0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-da33be86-2e17-4d8c-95ed-6f4889c7dac9 req-b5919c50-70d8-42b3-9aa7-df4f87f6ce7d service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Refreshing instance network info cache due to event network-changed-0741e554-620f-442e-b359-4d2c83da491a. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da33be86-2e17-4d8c-95ed-6f4889c7dac9 req-b5919c50-70d8-42b3-9aa7-df4f87f6ce7d service nova] Acquiring lock "refresh_cache-2b0bb153-7800-4298-a293-7a2b8cebb194" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Updating instance_info_cache with network_info: [{"id": "0741e554-620f-442e-b359-4d2c83da491a", "address": "fa:16:3e:96:72:be", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0741e554-62", "ovs_interfaceid": "0741e554-620f-442e-b359-4d2c83da491a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Releasing lock "refresh_cache-2b0bb153-7800-4298-a293-7a2b8cebb194" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Instance network_info: |[{"id": "0741e554-620f-442e-b359-4d2c83da491a", "address": "fa:16:3e:96:72:be", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0741e554-62", "ovs_interfaceid": "0741e554-620f-442e-b359-4d2c83da491a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da33be86-2e17-4d8c-95ed-6f4889c7dac9 req-b5919c50-70d8-42b3-9aa7-df4f87f6ce7d service nova] Acquired lock "refresh_cache-2b0bb153-7800-4298-a293-7a2b8cebb194" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-da33be86-2e17-4d8c-95ed-6f4889c7dac9 req-b5919c50-70d8-42b3-9aa7-df4f87f6ce7d service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Refreshing network info cache for port 0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:04:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG nova.network.neutron [req-da33be86-2e17-4d8c-95ed-6f4889c7dac9 req-b5919c50-70d8-42b3-9aa7-df4f87f6ce7d service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Updated VIF entry in instance network info cache for port 0741e554-620f-442e-b359-4d2c83da491a. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG nova.network.neutron [req-da33be86-2e17-4d8c-95ed-6f4889c7dac9 req-b5919c50-70d8-42b3-9aa7-df4f87f6ce7d service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Updating instance_info_cache with network_info: [{"id": "0741e554-620f-442e-b359-4d2c83da491a", "address": "fa:16:3e:96:72:be", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0741e554-62", "ovs_interfaceid": "0741e554-620f-442e-b359-4d2c83da491a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da33be86-2e17-4d8c-95ed-6f4889c7dac9 req-b5919c50-70d8-42b3-9aa7-df4f87f6ce7d service nova] Releasing lock "refresh_cache-2b0bb153-7800-4298-a293-7a2b8cebb194" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:50 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:51 user nova-compute[82184]: INFO nova.compute.manager [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Terminating instance
Apr 12 02:04:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-82c9fcc0-f257-4165-8dbf-c52005315c03 req-5945b5d7-d51d-40e1-b564-4972efd75dbd service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-unplugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-82c9fcc0-f257-4165-8dbf-c52005315c03 req-5945b5d7-d51d-40e1-b564-4972efd75dbd service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-82c9fcc0-f257-4165-8dbf-c52005315c03 req-5945b5d7-d51d-40e1-b564-4972efd75dbd service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-82c9fcc0-f257-4165-8dbf-c52005315c03 req-5945b5d7-d51d-40e1-b564-4972efd75dbd service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-82c9fcc0-f257-4165-8dbf-c52005315c03 req-5945b5d7-d51d-40e1-b564-4972efd75dbd service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-unplugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-82c9fcc0-f257-4165-8dbf-c52005315c03 req-5945b5d7-d51d-40e1-b564-4972efd75dbd service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-unplugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:52 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Instance destroyed successfully.
Apr 12 02:04:52 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:04:52 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8043MB free_disk=26.4200439453125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.objects.instance [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'resources' on Instance uuid 84b4902c-24d9-4e96-b51f-e93e913aa681 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1373752537',display_name='tempest-ServerRescueNegativeTestJSON-server-1373752537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1373752537',id=21,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIbKc6xSzjYSTxxI8C/IAZs7b7MlyezBiUXhjYxXfwthgDrpaDZJYY7wb6RFJBJGBUJGdDeu+0PCYgm+2/EOL1dCVnyqQ1ADD+YRouh7yBs349raBu7ykBoZaVMgsZIuA==',key_name='tempest-keypair-2119544665',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:00:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-gcc6bego',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:02:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='889189da060e4b54a48ce9a013e04a3d',uuid=84b4902c-24d9-4e96-b51f-e93e913aa681,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "address": "fa:16:3e:fd:07:d9", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1709cc0-5e", "ovs_interfaceid": "b1709cc0-5e25-4f89-aa42-8bc0a424adc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=b1709cc0-5e25-4f89-aa42-8bc0a424adc1,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1709cc0-5e') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG os_vif [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=b1709cc0-5e25-4f89-aa42-8bc0a424adc1,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1709cc0-5e') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1709cc0-5e, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:04:52 user nova-compute[82184]: INFO os_vif [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:07:d9,bridge_name='br-int',has_traffic_filtering=True,id=b1709cc0-5e25-4f89-aa42-8bc0a424adc1,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1709cc0-5e')
Apr 12 02:04:52 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Deleting instance files /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681_del
Apr 12 02:04:52 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Deletion of /opt/stack/data/nova/instances/84b4902c-24d9-4e96-b51f-e93e913aa681_del complete
Apr 12 02:04:52 user nova-compute[82184]: INFO nova.compute.manager [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 12 02:04:52 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 84b4902c-24d9-4e96-b51f-e93e913aa681 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 101410fb-7682-46d8-baf1-18fcebf81cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance b8c39c58-73b3-4574-9fcf-0c5901a81aa0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 1a3c868f-3a4c-430e-8009-7a855e832f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2b0bb153-7800-4298-a293-7a2b8cebb194 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:04:52 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.681s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:04:53 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Took 0.88 seconds to deallocate network for instance.
Apr 12 02:04:53 user nova-compute[82184]: DEBUG os_brick.utils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-bb3bc082-2e7c-458a-ae43-2ef3d4cbda3f req-6a0d914d-025d-4c68-8832-e7e975cd2148 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-deleted-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:04:53 user nova-compute[82184]: INFO nova.compute.manager [req-bb3bc082-2e7c-458a-ae43-2ef3d4cbda3f req-6a0d914d-025d-4c68-8832-e7e975cd2148 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Neutron deleted interface b1709cc0-5e25-4f89-aa42-8bc0a424adc1; detaching it from the instance and deleting it from the info cache
Apr 12 02:04:53 user nova-compute[82184]: DEBUG nova.network.neutron [req-bb3bc082-2e7c-458a-ae43-2ef3d4cbda3f req-6a0d914d-025d-4c68-8832-e7e975cd2148 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b969c614-605a-464f-90b9-7ba1e855f7cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8408070-7af8-48e7-9e16-b8f0dcc0f6ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-bb3bc082-2e7c-458a-ae43-2ef3d4cbda3f req-6a0d914d-025d-4c68-8832-e7e975cd2148 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Detach interface failed, port_id=b1709cc0-5e25-4f89-aa42-8bc0a424adc1, reason: Instance 84b4902c-24d9-4e96-b51f-e93e913aa681 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[128da022-e842-414c-97f1-e86e7687a029]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[774fba8b-9e9b-4596-a464-917fc0fba892]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:04:53 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bf3130-0959-46ae-bfe0-f9b6164ff8d5]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG os_brick.utils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Updating existing volume attachment record: 37a6be25-fa90-48ea-bb7a-27af57a0cb2d {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-f4746aaa-c475-46ec-930f-147787bda325 req-9d5b5e69-c65e-494e-942a-65cd747fbb52 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f4746aaa-c475-46ec-930f-147787bda325 req-9d5b5e69-c65e-494e-942a-65cd747fbb52 service nova] Acquiring lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f4746aaa-c475-46ec-930f-147787bda325 req-9d5b5e69-c65e-494e-942a-65cd747fbb52 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f4746aaa-c475-46ec-930f-147787bda325 req-9d5b5e69-c65e-494e-942a-65cd747fbb52 service nova] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-f4746aaa-c475-46ec-930f-147787bda325 req-9d5b5e69-c65e-494e-942a-65cd747fbb52 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] No waiting events found dispatching network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:04:53 user nova-compute[82184]: WARNING nova.compute.manager [req-f4746aaa-c475-46ec-930f-147787bda325 req-9d5b5e69-c65e-494e-942a-65cd747fbb52 service nova] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Received unexpected event network-vif-plugged-b1709cc0-5e25-4f89-aa42-8bc0a424adc1 for instance with vm_state deleted and task_state None.
Apr 12 02:04:53 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:53 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Deleted allocations for instance 84b4902c-24d9-4e96-b51f-e93e913aa681
Apr 12 02:04:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-22e4a434-221d-4488-8661-98cefdf348cf tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "84b4902c-24d9-4e96-b51f-e93e913aa681" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.636s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Updating instance_info_cache with network_info: [{"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:04:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:04:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:04:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:04:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:04:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:04:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:04:58 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Creating image(s)
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Ensure instance console log exists: /opt/stack/data/nova/instances/2b0bb153-7800-4298-a293-7a2b8cebb194/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Start _get_guest_xml network_info=[{"id": "0741e554-620f-442e-b359-4d2c83da491a", "address": "fa:16:3e:96:72:be", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0741e554-62", "ovs_interfaceid": "0741e554-620f-442e-b359-4d2c83da491a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '37a6be25-fa90-48ea-bb7a-27af57a0cb2d', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTgeoCyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2b0bb153-7800-4298-a293-7a2b8cebb194', 'attached_at': '', 'detached_at': '', 'volume_id': 'c271b093-8900-41a9-ad42-5c49a78dfd28', 'serial': 'c271b093-8900-41a9-ad42-5c49a78dfd28'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:04:58 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:04:58 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTgeoCyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:04:58 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:04:58 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:04:58 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71685f0-ae0d-4c4c-bdb2-ba3d7cbad197]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:04:58 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d448073-7598-442e-befe-bc674c87742c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28] added
Apr 12 02:04:58 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddee32c-c7ce-4cf5-9e73-9d36a2e1e06b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbfb31a-53ce-479d-bea6-ff060eee6022]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTgeoCyi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTgeoCyi" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdd9483-08ae-4514-a9f3-125ae2cac104]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NTgeoCyi'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f924d7-689b-429c-a4e3-97086082bcbf]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f537f055-edcf-40c3-bd19-4147b3f45fee]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:04:58 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:04:58 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:04:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f353e5-9cfb-4649-b7b0-77ff71414db7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28, portal: 172.16.0.220,3260]
Apr 12 02:04:59 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28, portal: 172.16.0.220,3260] successful.
Apr 12 02:04:59 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4f1cff-bcb3-4a38-85a2-35f85efdcb60]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb05203-6438-4048-afd9-536e5e4b06a4]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:04:59 user nova-compute[82184]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:04:59 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:04:59 user nova-compute[82184]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:04:59 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c8cb6a-962a-486c-b25b-ff56c7d52589]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:04:59 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTgeoCyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23664633332313537', 'path': '/dev/sdc'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664633332313537', 'path': '/dev/sdc'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:04:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1161614728',display_name='tempest-TestVolumeBootPattern-server-1161614728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1161614728',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-gnsiy22n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:04:48Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=2b0bb153-7800-4298-a293-7a2b8cebb194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0741e554-620f-442e-b359-4d2c83da491a", "address": "fa:16:3e:96:72:be", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0741e554-62", "ovs_interfaceid": "0741e554-620f-442e-b359-4d2c83da491a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "0741e554-620f-442e-b359-4d2c83da491a", "address": "fa:16:3e:96:72:be", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0741e554-62", "ovs_interfaceid": "0741e554-620f-442e-b359-4d2c83da491a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:72:be,bridge_name='br-int',has_traffic_filtering=True,id=0741e554-620f-442e-b359-4d2c83da491a,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0741e554-62') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.objects.instance [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b0bb153-7800-4298-a293-7a2b8cebb194 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:05:00 user nova-compute[82184]:   <uuid>2b0bb153-7800-4298-a293-7a2b8cebb194</uuid>
Apr 12 02:05:00 user nova-compute[82184]:   <name>instance-0000001d</name>
Apr 12 02:05:00 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:05:00 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:05:00 user nova-compute[82184]:   <metadata>
Apr 12 02:05:00 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:05:00 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:05:00 user nova-compute[82184]:       <nova:name>tempest-TestVolumeBootPattern-server-1161614728</nova:name>
Apr 12 02:05:00 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:04:58</nova:creationTime>
Apr 12 02:05:00 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:05:00 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:05:00 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:05:00 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:05:00 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:05:00 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:05:00 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:05:00 user nova-compute[82184]:       <nova:owner>
Apr 12 02:05:00 user nova-compute[82184]:         <nova:user uuid="69d5d81fffb14b1cab84b6160ceb7dd2">tempest-TestVolumeBootPattern-2043953815-project-member</nova:user>
Apr 12 02:05:00 user nova-compute[82184]:         <nova:project uuid="bcd685278576490480a97cd2bc5e048b">tempest-TestVolumeBootPattern-2043953815</nova:project>
Apr 12 02:05:00 user nova-compute[82184]:       </nova:owner>
Apr 12 02:05:00 user nova-compute[82184]:       <nova:ports>
Apr 12 02:05:00 user nova-compute[82184]:         <nova:port uuid="0741e554-620f-442e-b359-4d2c83da491a">
Apr 12 02:05:00 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 02:05:00 user nova-compute[82184]:         </nova:port>
Apr 12 02:05:00 user nova-compute[82184]:       </nova:ports>
Apr 12 02:05:00 user nova-compute[82184]:     </nova:instance>
Apr 12 02:05:00 user nova-compute[82184]:   </metadata>
Apr 12 02:05:00 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:05:00 user nova-compute[82184]:     <system>
Apr 12 02:05:00 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:05:00 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:05:00 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:05:00 user nova-compute[82184]:       <entry name="serial">2b0bb153-7800-4298-a293-7a2b8cebb194</entry>
Apr 12 02:05:00 user nova-compute[82184]:       <entry name="uuid">2b0bb153-7800-4298-a293-7a2b8cebb194</entry>
Apr 12 02:05:00 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:05:00 user nova-compute[82184]:     </system>
Apr 12 02:05:00 user nova-compute[82184]:   </sysinfo>
Apr 12 02:05:00 user nova-compute[82184]:   <os>
Apr 12 02:05:00 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:05:00 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:05:00 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:05:00 user nova-compute[82184]:   </os>
Apr 12 02:05:00 user nova-compute[82184]:   <features>
Apr 12 02:05:00 user nova-compute[82184]:     <acpi/>
Apr 12 02:05:00 user nova-compute[82184]:     <apic/>
Apr 12 02:05:00 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:05:00 user nova-compute[82184]:   </features>
Apr 12 02:05:00 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:05:00 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:05:00 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:05:00 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:05:00 user nova-compute[82184]:   </clock>
Apr 12 02:05:00 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:05:00 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:05:00 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:05:00 user nova-compute[82184]:   </cpu>
Apr 12 02:05:00 user nova-compute[82184]:   <devices>
Apr 12 02:05:00 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:05:00 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:05:00 user nova-compute[82184]:       <source dev="/dev/sdc"/>
Apr 12 02:05:00 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:05:00 user nova-compute[82184]:       <serial>c271b093-8900-41a9-ad42-5c49a78dfd28</serial>
Apr 12 02:05:00 user nova-compute[82184]:     </disk>
Apr 12 02:05:00 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:05:00 user nova-compute[82184]:       <mac address="fa:16:3e:96:72:be"/>
Apr 12 02:05:00 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:05:00 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:05:00 user nova-compute[82184]:       <target dev="tap0741e554-62"/>
Apr 12 02:05:00 user nova-compute[82184]:     </interface>
Apr 12 02:05:00 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:05:00 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/2b0bb153-7800-4298-a293-7a2b8cebb194/console.log" append="off"/>
Apr 12 02:05:00 user nova-compute[82184]:     </serial>
Apr 12 02:05:00 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:05:00 user nova-compute[82184]:     <video>
Apr 12 02:05:00 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:05:00 user nova-compute[82184]:     </video>
Apr 12 02:05:00 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:05:00 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:05:00 user nova-compute[82184]:     </rng>
Apr 12 02:05:00 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:05:00 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:05:00 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:05:00 user nova-compute[82184]:     </memballoon>
Apr 12 02:05:00 user nova-compute[82184]:   </devices>
Apr 12 02:05:00 user nova-compute[82184]: </domain>
Apr 12 02:05:00 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:04:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1161614728',display_name='tempest-TestVolumeBootPattern-server-1161614728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1161614728',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-gnsiy22n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:04:48Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=2b0bb153-7800-4298-a293-7a2b8cebb194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0741e554-620f-442e-b359-4d2c83da491a", "address": "fa:16:3e:96:72:be", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0741e554-62", "ovs_interfaceid": "0741e554-620f-442e-b359-4d2c83da491a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "0741e554-620f-442e-b359-4d2c83da491a", "address": "fa:16:3e:96:72:be", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0741e554-62", "ovs_interfaceid": "0741e554-620f-442e-b359-4d2c83da491a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:72:be,bridge_name='br-int',has_traffic_filtering=True,id=0741e554-620f-442e-b359-4d2c83da491a,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0741e554-62') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG os_vif [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:72:be,bridge_name='br-int',has_traffic_filtering=True,id=0741e554-620f-442e-b359-4d2c83da491a,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0741e554-62') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0741e554-62, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0741e554-62, col_values=(('external_ids', {'iface-id': '0741e554-620f-442e-b359-4d2c83da491a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:72:be', 'vm-uuid': '2b0bb153-7800-4298-a293-7a2b8cebb194'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:00 user nova-compute[82184]: INFO os_vif [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:72:be,bridge_name='br-int',has_traffic_filtering=True,id=0741e554-620f-442e-b359-4d2c83da491a,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0741e554-62')
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No VIF found with MAC fa:16:3e:96:72:be, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:05:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-0756d54c-26c3-43a4-b2b1-0687d6180810 req-3052f83f-53cb-49f1-ad8d-01a732e49afd service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Received event network-vif-plugged-0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0756d54c-26c3-43a4-b2b1-0687d6180810 req-3052f83f-53cb-49f1-ad8d-01a732e49afd service nova] Acquiring lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0756d54c-26c3-43a4-b2b1-0687d6180810 req-3052f83f-53cb-49f1-ad8d-01a732e49afd service nova] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0756d54c-26c3-43a4-b2b1-0687d6180810 req-3052f83f-53cb-49f1-ad8d-01a732e49afd service nova] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-0756d54c-26c3-43a4-b2b1-0687d6180810 req-3052f83f-53cb-49f1-ad8d-01a732e49afd service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] No waiting events found dispatching network-vif-plugged-0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:05:01 user nova-compute[82184]: WARNING nova.compute.manager [req-0756d54c-26c3-43a4-b2b1-0687d6180810 req-3052f83f-53cb-49f1-ad8d-01a732e49afd service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Received unexpected event network-vif-plugged-0741e554-620f-442e-b359-4d2c83da491a for instance with vm_state building and task_state spawning.
Apr 12 02:05:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-102465ce-d47c-498c-accc-992a00925b2e req-293e9cfe-7107-48ef-b0b1-0ce9c0d021a8 service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received event network-changed-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-102465ce-d47c-498c-accc-992a00925b2e req-293e9cfe-7107-48ef-b0b1-0ce9c0d021a8 service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Refreshing instance network info cache due to event network-changed-280a0eb1-7bff-42d2-a75e-69eba211ffbb. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-102465ce-d47c-498c-accc-992a00925b2e req-293e9cfe-7107-48ef-b0b1-0ce9c0d021a8 service nova] Acquiring lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-102465ce-d47c-498c-accc-992a00925b2e req-293e9cfe-7107-48ef-b0b1-0ce9c0d021a8 service nova] Acquired lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-102465ce-d47c-498c-accc-992a00925b2e req-293e9cfe-7107-48ef-b0b1-0ce9c0d021a8 service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Refreshing network info cache for port 280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:02 user nova-compute[82184]: INFO nova.compute.manager [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attaching volume 346aa006-77dd-40bf-8a85-084d40c55ffe to /dev/vdb
Apr 12 02:05:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-102465ce-d47c-498c-accc-992a00925b2e req-293e9cfe-7107-48ef-b0b1-0ce9c0d021a8 service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updated VIF entry in instance network info cache for port 280a0eb1-7bff-42d2-a75e-69eba211ffbb. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-102465ce-d47c-498c-accc-992a00925b2e req-293e9cfe-7107-48ef-b0b1-0ce9c0d021a8 service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updating instance_info_cache with network_info: [{"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-102465ce-d47c-498c-accc-992a00925b2e req-293e9cfe-7107-48ef-b0b1-0ce9c0d021a8 service nova] Releasing lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG os_brick.utils [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1dc5b4-e4cc-4b22-b4f0-d198a500d655]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[561a4a0b-43cb-452e-9783-992123f359b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07326d7-bdbc-4bc9-889f-57b6688c2424]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd40061b-3e62-4d92-812e-3cb6d66fc2ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:05:02 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:05:02 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0df8e6a-7258-4d7e-8c84-d8bebb8adbc5]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG os_brick.utils [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:05:02 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updating existing volume attachment record: fd769247-4b48-4661-b4b7-10d3f6d37ac9 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265103.6962698, 2b0bb153-7800-4298-a293-7a2b8cebb194 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:05:03 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] VM Resumed (Lifecycle Event)
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:05:03 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Instance spawned successfully.
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:05:03 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265103.6971498, 2b0bb153-7800-4298-a293-7a2b8cebb194 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:05:03 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] VM Started (Lifecycle Event)
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-b68a2919-8abc-400e-95b1-ee5ac54cbae7 req-0523c4b7-3da6-4f75-9215-6180c97c7f08 service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Received event network-vif-plugged-0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b68a2919-8abc-400e-95b1-ee5ac54cbae7 req-0523c4b7-3da6-4f75-9215-6180c97c7f08 service nova] Acquiring lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b68a2919-8abc-400e-95b1-ee5ac54cbae7 req-0523c4b7-3da6-4f75-9215-6180c97c7f08 service nova] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b68a2919-8abc-400e-95b1-ee5ac54cbae7 req-0523c4b7-3da6-4f75-9215-6180c97c7f08 service nova] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-b68a2919-8abc-400e-95b1-ee5ac54cbae7 req-0523c4b7-3da6-4f75-9215-6180c97c7f08 service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] No waiting events found dispatching network-vif-plugged-0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:05:03 user nova-compute[82184]: WARNING nova.compute.manager [req-b68a2919-8abc-400e-95b1-ee5ac54cbae7 req-0523c4b7-3da6-4f75-9215-6180c97c7f08 service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Received unexpected event network-vif-plugged-0741e554-620f-442e-b359-4d2c83da491a for instance with vm_state building and task_state spawning.
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:05:03 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:05:03 user nova-compute[82184]: INFO nova.compute.manager [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Took 5.08 seconds to spawn the instance on the hypervisor.
Apr 12 02:05:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:05:03 user nova-compute[82184]: INFO nova.compute.manager [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Took 16.60 seconds to build instance.
Apr 12 02:05:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1b11e0f7-b021-4a15-a385-e0c129ac76d9 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.691s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLmabCkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:05:07 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:05:07 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:05:07 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a64c9c-ccf1-48eb-b04d-44e0eef6500d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:05:07 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bee7c26-6503-4f21-b14f-8401a0db8736]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe] added
Apr 12 02:05:07 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898615f-c3a5-498e-ac27-6bb32723f47e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2783fa76-2187-4c49-a660-f77b68fcfefb]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WLmabCkz {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WLmabCkz" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b794f87d-fa04-4dc9-b0b4-cb8a8216d00f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WLmabCkz'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4499af77-c0fd-43c8-a666-418b2d8dabae]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec6582-a4db-435f-aa66-a62fd984c814]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:05:07 user nova-compute[82184]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:05:07 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:05:07 user nova-compute[82184]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:05:07 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b5b066-52d1-47ad-8f14-4ab533bb7546]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe, portal: 172.16.0.220,3260]
Apr 12 02:05:07 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe, portal: 172.16.0.220,3260] successful.
Apr 12 02:05:07 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265092.107956, 84b4902c-24d9-4e96-b51f-e93e913aa681 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:05:07 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] VM Stopped (Lifecycle Event)
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[958b6e47-a73a-46f2-8824-6407dfb6e8f1]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-7cf99179-654c-444f-b301-340653b3c66b None None] [instance: 84b4902c-24d9-4e96-b51f-e93e913aa681] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e43c2be-3312-4c93-92c9-b3a254946642]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:05:07 user nova-compute[82184]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:05:07 user nova-compute[82184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe (non-flash)
Apr 12 02:05:07 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:05:07 user nova-compute[82184]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:05:07 user nova-compute[82184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe (non-flash)
Apr 12 02:05:07 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d76cf5-3193-4820-8f46-8495c6999eaa]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:05:07 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLmabCkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:05:08 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:05:08 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23132393762663934', 'path': '/dev/sdd'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:05:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132393762663934', 'path': '/dev/sdd'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:05:08 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:05:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:05:08 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:05:08 user nova-compute[82184]:   <source dev="/dev/sdd"/>
Apr 12 02:05:08 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:05:08 user nova-compute[82184]:   <serial>346aa006-77dd-40bf-8a85-084d40c55ffe</serial>
Apr 12 02:05:08 user nova-compute[82184]: </disk>
Apr 12 02:05:08 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:05:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:05:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:05:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No VIF found with MAC fa:16:3e:e2:49:7f, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:05:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e03670ad-4da7-4ca6-9657-28d2d041a4fa tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.416s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:16 user nova-compute[82184]: INFO nova.compute.manager [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Terminating instance
Apr 12 02:05:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:05:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:17 user nova-compute[82184]: INFO nova.compute.manager [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Detaching volume 346aa006-77dd-40bf-8a85-084d40c55ffe
Apr 12 02:05:17 user nova-compute[82184]: INFO nova.virt.block_device [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attempting to driver detach volume 346aa006-77dd-40bf-8a85-084d40c55ffe from mountpoint /dev/vdb
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Attempting to detach device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:05:17 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:05:17 user nova-compute[82184]:   <source dev="/dev/sdd"/>
Apr 12 02:05:17 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:05:17 user nova-compute[82184]:   <serial>346aa006-77dd-40bf-8a85-084d40c55ffe</serial>
Apr 12 02:05:17 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:05:17 user nova-compute[82184]: </disk>
Apr 12 02:05:17 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:05:17 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Successfully detached device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the persistent domain config.
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:05:17 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:05:17 user nova-compute[82184]:   <source dev="/dev/sdd"/>
Apr 12 02:05:17 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:05:17 user nova-compute[82184]:   <serial>346aa006-77dd-40bf-8a85-084d40c55ffe</serial>
Apr 12 02:05:17 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:05:17 user nova-compute[82184]: </disk>
Apr 12 02:05:17 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-1fef44ed-61a7-4b61-9493-a6988dfb072d req-d27579a5-6cf2-490e-b3e3-fa4e8d353c86 service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received event network-vif-unplugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1fef44ed-61a7-4b61-9493-a6988dfb072d req-d27579a5-6cf2-490e-b3e3-fa4e8d353c86 service nova] Acquiring lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1fef44ed-61a7-4b61-9493-a6988dfb072d req-d27579a5-6cf2-490e-b3e3-fa4e8d353c86 service nova] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1fef44ed-61a7-4b61-9493-a6988dfb072d req-d27579a5-6cf2-490e-b3e3-fa4e8d353c86 service nova] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-1fef44ed-61a7-4b61-9493-a6988dfb072d req-d27579a5-6cf2-490e-b3e3-fa4e8d353c86 service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] No waiting events found dispatching network-vif-unplugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-1fef44ed-61a7-4b61-9493-a6988dfb072d req-d27579a5-6cf2-490e-b3e3-fa4e8d353c86 service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received event network-vif-unplugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-4008f847-acb6-402a-b77a-1b535feab6f5 req-3dd1d418-93cc-4d20-a320-546d58facd70 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-changed-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-4008f847-acb6-402a-b77a-1b535feab6f5 req-3dd1d418-93cc-4d20-a320-546d58facd70 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Refreshing instance network info cache due to event network-changed-b64bd49d-20d0-4f9d-b07c-078a55b0542f. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4008f847-acb6-402a-b77a-1b535feab6f5 req-3dd1d418-93cc-4d20-a320-546d58facd70 service nova] Acquiring lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4008f847-acb6-402a-b77a-1b535feab6f5 req-3dd1d418-93cc-4d20-a320-546d58facd70 service nova] Acquired lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.network.neutron [req-4008f847-acb6-402a-b77a-1b535feab6f5 req-3dd1d418-93cc-4d20-a320-546d58facd70 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Refreshing network info cache for port b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:17 user nova-compute[82184]: INFO nova.compute.manager [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Terminating instance
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681265117.9872353, 101410fb-7682-46d8-baf1-18fcebf81cb8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:05:17 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Successfully detached device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the live domain config.
Apr 12 02:05:17 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Instance destroyed successfully.
Apr 12 02:05:17 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'resources' on Instance uuid 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WLmabCkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:05:18 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-376857066',display_name='tempest-AttachVolumeNegativeTest-server-376857066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-376857066',id=22,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyQPgNnY+n5pmjFnlz3V3O4w81ZzobntB8dh+2yVFNBNym/eGJJo7urnH/zX2dzy5CA7558+VofCPs+9Vde/YZ1+ziQKJzVrqQuhHVBk0QzvwcemmNSiwyqvFvAu2VGhg==',key_name='tempest-keypair-97228139',keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-ykbik2fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:59:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "address": "fa:16:3e:92:85:d6", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc0f00ae-18", "ovs_interfaceid": "bc0f00ae-1855-439a-a945-9cc72e70fcc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc0f00ae-1855-439a-a945-9cc72e70fcc4,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0f00ae-18') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_vif [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc0f00ae-1855-439a-a945-9cc72e70fcc4,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0f00ae-18') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc0f00ae-18, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a700f8d2-3d29-4bee-9f07-0dc269d1d113]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:05:18 user nova-compute[82184]: No targets found.
Apr 12 02:05:18 user nova-compute[82184]: iSNS:
Apr 12 02:05:18 user nova-compute[82184]: No targets found.
Apr 12 02:05:18 user nova-compute[82184]: STATIC:
Apr 12 02:05:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7
Apr 12 02:05:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:05:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:05:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28
Apr 12 02:05:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:05:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:05:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe
Apr 12 02:05:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:05:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:05:18 user nova-compute[82184]: FIRMWARE:
Apr 12 02:05:18 user nova-compute[82184]: No targets found.
Apr 12 02:05:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:05:18 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:05:18 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:18 user nova-compute[82184]: INFO os_vif [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:85:d6,bridge_name='br-int',has_traffic_filtering=True,id=bc0f00ae-1855-439a-a945-9cc72e70fcc4,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc0f00ae-18')
Apr 12 02:05:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Deleting instance files /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd_del
Apr 12 02:05:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Deletion of /opt/stack/data/nova/instances/92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd_del complete
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d86468e-09b5-4bc4-ac6a-1a340b6f7be2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e45406c-2c84-4d0d-8afd-14861fa5c905]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:05:18 user nova-compute[82184]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:05:18 user nova-compute[82184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe (non-flash)
Apr 12 02:05:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:05:18 user nova-compute[82184]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:05:18 user nova-compute[82184]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe (non-flash)
Apr 12 02:05:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f268824ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe'): ({'sdd'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Removing single pathed devices sdd {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2e1fc8-3b7d-45ef-982c-0a0cc6cdf082]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b89fc-504b-420c-bc01-d6455fe03699]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Flushing IO for device /dev/sdd {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: INFO nova.compute.manager [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1feb271-4fe3-446a-b8d9-8de0234ea92c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd82201-76e0-4a20-9e1d-9f30f582c8d8]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd7b214-914d-4b4f-906f-8802945c2b03]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c368119-500b-4539-981b-b78d61b94629]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe, portal: 172.16.0.220,3260]
Apr 12 02:05:18 user nova-compute[82184]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe, portal: 172.16.0.220,3260] successful.
Apr 12 02:05:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:346aa006-77dd-40bf-8a85-084d40c55ffe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2ce402-97ce-48ed-a7b7-15c445925f56]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== disconnect_volume: return (358ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.network.neutron [req-4008f847-acb6-402a-b77a-1b535feab6f5 req-3dd1d418-93cc-4d20-a320-546d58facd70 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updated VIF entry in instance network info cache for port b64bd49d-20d0-4f9d-b07c-078a55b0542f. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.network.neutron [req-4008f847-acb6-402a-b77a-1b535feab6f5 req-3dd1d418-93cc-4d20-a320-546d58facd70 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating instance_info_cache with network_info: [{"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4008f847-acb6-402a-b77a-1b535feab6f5 req-3dd1d418-93cc-4d20-a320-546d58facd70 service nova] Releasing lock "refresh_cache-b8c39c58-73b3-4574-9fcf-0c5901a81aa0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:05:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Instance destroyed successfully.
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lazy-loading 'resources' on Instance uuid b8c39c58-73b3-4574-9fcf-0c5901a81aa0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T01:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-662581423',display_name='tempest-TestShelveInstance-server-662581423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-662581423',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzJEkyxrgGdFi9xp4HEHo6h+HMI/sf0D1BEcLp1PlBC0aEIXZkpEAZB7dj1l2oKNIXETzcME23LJ7KETYvsoSN/f9VetiXUt+tFF8xxyxwD7zg/09NP8sJhNpL272IgEg==',key_name='tempest-TestShelveInstance-269156000',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:03:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97353e0d7e084a1095d6ae46416d5660',ramdisk_id='',reservation_id='r-68gx34k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1070508789',owner_user_name='tempest-TestShelveInstance-1070508789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:03:39Z,user_data=None,user_id='5108c5bde1e249a2934f3e47496b1027',uuid=b8c39c58-73b3-4574-9fcf-0c5901a81aa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converting VIF {"id": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "address": "fa:16:3e:13:82:50", "network": {"id": "6773c41d-3492-43c6-b74a-688f2d7b9fc5", "bridge": "br-int", "label": "tempest-TestShelveInstance-1729620221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97353e0d7e084a1095d6ae46416d5660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64bd49d-20", "ovs_interfaceid": "b64bd49d-20d0-4f9d-b07c-078a55b0542f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_vif [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb64bd49d-20, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:05:18 user nova-compute[82184]: INFO os_vif [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:82:50,bridge_name='br-int',has_traffic_filtering=True,id=b64bd49d-20d0-4f9d-b07c-078a55b0542f,network=Network(6773c41d-3492-43c6-b74a-688f2d7b9fc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64bd49d-20')
Apr 12 02:05:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AEchyUgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:05:18 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1714428-1cb4-4ba2-8284-556fd1075e61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:05:18 user nova-compute[82184]: No targets found.
Apr 12 02:05:18 user nova-compute[82184]: iSNS:
Apr 12 02:05:18 user nova-compute[82184]: No targets found.
Apr 12 02:05:18 user nova-compute[82184]: STATIC:
Apr 12 02:05:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7
Apr 12 02:05:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:05:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:05:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28
Apr 12 02:05:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:05:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:05:18 user nova-compute[82184]: FIRMWARE:
Apr 12 02:05:18 user nova-compute[82184]: No targets found.
Apr 12 02:05:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:05:18 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:05:18 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[684bc6e9-d1e1-46c7-ac04-8024f459e48d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f029b8-fa70-488e-ad0f-c1e7f1e4529b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:05:18 user nova-compute[82184]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:05:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 (non-flash)
Apr 12 02:05:18 user nova-compute[82184]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:05:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b4d50c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62db0ce-df38-49a6-bfaa-1dda3533c386]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4ad928-ad0d-44f9-8df5-feda154c2c3c]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[097d4969-40cb-47b4-a5a7-57953aae40eb]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[31735174-d5a3-457c-a0c8-6ee971510b2c]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c4de0039', '/dev/disk/by-id/scsi-23734336161353763', '/dev/disk/by-id/scsi-1SCST_BIOc4de0039-743aa57c902814a8') {{(pid=92498) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9774fada-8558-444c-acfc-b7cd2e20270d]: (4, None) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:05:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa068d4-4dc2-4311-b149-997b7f1bfb12]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabc5755-9dcd-48b0-b454-28fd46b2ef99]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260]
Apr 12 02:05:19 user nova-compute[82184]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7, portal: 172.16.0.220,3260] successful.
Apr 12 02:05:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d89fd1-2c63-48c0-8341-1af121bc4cc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d34e3ce-e0b7-4f7d-b5cf-537054250eb4]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] <== disconnect_volume: return (335ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:05:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Deleting instance files /opt/stack/data/nova/instances/b8c39c58-73b3-4574-9fcf-0c5901a81aa0_del
Apr 12 02:05:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Deletion of /opt/stack/data/nova/instances/b8c39c58-73b3-4574-9fcf-0c5901a81aa0_del complete
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:05:19 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Took 1.01 seconds to deallocate network for instance.
Apr 12 02:05:19 user nova-compute[82184]: INFO nova.compute.manager [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Took 1.35 seconds to destroy the instance on the hypervisor.
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-82209738-2a7f-458c-adf9-ec971a00201b tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.316s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-24e94151-4f99-417c-8081-3b9486265966 req-c28e5ece-2cbe-4bb0-b30e-b4d610b2435e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received event network-vif-plugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-24e94151-4f99-417c-8081-3b9486265966 req-c28e5ece-2cbe-4bb0-b30e-b4d610b2435e service nova] Acquiring lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-24e94151-4f99-417c-8081-3b9486265966 req-c28e5ece-2cbe-4bb0-b30e-b4d610b2435e service nova] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-24e94151-4f99-417c-8081-3b9486265966 req-c28e5ece-2cbe-4bb0-b30e-b4d610b2435e service nova] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-24e94151-4f99-417c-8081-3b9486265966 req-c28e5ece-2cbe-4bb0-b30e-b4d610b2435e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] No waiting events found dispatching network-vif-plugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:05:19 user nova-compute[82184]: WARNING nova.compute.manager [req-24e94151-4f99-417c-8081-3b9486265966 req-c28e5ece-2cbe-4bb0-b30e-b4d610b2435e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received unexpected event network-vif-plugged-bc0f00ae-1855-439a-a945-9cc72e70fcc4 for instance with vm_state deleted and task_state None.
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-24e94151-4f99-417c-8081-3b9486265966 req-c28e5ece-2cbe-4bb0-b30e-b4d610b2435e service nova] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Received event network-vif-deleted-bc0f00ae-1855-439a-a945-9cc72e70fcc4 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:19 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Deleted allocations for instance 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4cca24c9-49e5-44b1-957d-5e5a45460656 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.726s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:05:19 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Took 0.48 seconds to deallocate network for instance.
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-vif-unplugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] No waiting events found dispatching network-vif-unplugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-vif-unplugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] Acquiring lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] No waiting events found dispatching network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:05:19 user nova-compute[82184]: WARNING nova.compute.manager [req-99e44dd3-521c-4d6e-bbc2-c3243c9f742c req-bb821d62-3fa1-4e4d-8729-e7234f4c9fac service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received unexpected event network-vif-plugged-b64bd49d-20d0-4f9d-b07c-078a55b0542f for instance with vm_state active and task_state deleting.
Apr 12 02:05:20 user nova-compute[82184]: INFO nova.compute.manager [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Took 0.76 seconds to detach 1 volumes for instance.
Apr 12 02:05:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Deleting volume: 11d89fd1-2c63-48c0-8341-1af121bc4cc7 {{(pid=82184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 02:05:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:20 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:05:20 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:05:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:20 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Deleted allocations for instance b8c39c58-73b3-4574-9fcf-0c5901a81aa0
Apr 12 02:05:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e9cd6447-47ba-42f1-bf3b-ee7b579df136 tempest-TestShelveInstance-1070508789 tempest-TestShelveInstance-1070508789-project-member] Lock "b8c39c58-73b3-4574-9fcf-0c5901a81aa0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.076s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-801b598d-ff97-4075-b977-a019220edeb3 req-d99ecbc5-b974-4afc-895f-b8befb95fca6 service nova] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Received event network-vif-deleted-b64bd49d-20d0-4f9d-b07c-078a55b0542f {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:32 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265117.9882727, 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:05:32 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] VM Stopped (Lifecycle Event)
Apr 12 02:05:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e7688f6c-044a-4012-baa1-80a36f219d25 None None] [instance: 92e8b4c7-58a2-4deb-b9a5-5de7d68c82fd] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:05:33 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265118.5981147, b8c39c58-73b3-4574-9fcf-0c5901a81aa0 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:05:33 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] VM Stopped (Lifecycle Event)
Apr 12 02:05:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1787483e-e97b-48a3-a28e-87ae6f5e8b1c None None] [instance: b8c39c58-73b3-4574-9fcf-0c5901a81aa0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:05:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:05:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:05:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:05:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:05:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:46 user nova-compute[82184]: INFO nova.compute.manager [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Terminating instance
Apr 12 02:05:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-c64a466a-b64c-412a-9436-3e3d2abfee32 req-265b31e8-449a-4ed8-b11d-f317a09c7661 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-vif-unplugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c64a466a-b64c-412a-9436-3e3d2abfee32 req-265b31e8-449a-4ed8-b11d-f317a09c7661 service nova] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c64a466a-b64c-412a-9436-3e3d2abfee32 req-265b31e8-449a-4ed8-b11d-f317a09c7661 service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c64a466a-b64c-412a-9436-3e3d2abfee32 req-265b31e8-449a-4ed8-b11d-f317a09c7661 service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-c64a466a-b64c-412a-9436-3e3d2abfee32 req-265b31e8-449a-4ed8-b11d-f317a09c7661 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] No waiting events found dispatching network-vif-unplugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG nova.compute.manager [req-c64a466a-b64c-412a-9436-3e3d2abfee32 req-265b31e8-449a-4ed8-b11d-f317a09c7661 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-vif-unplugged-7edd32c8-a71c-4552-bb85-a073a178f87d for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:05:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Instance destroyed successfully.
Apr 12 02:05:47 user nova-compute[82184]: DEBUG nova.objects.instance [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'resources' on Instance uuid d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-808158946',display_name='tempest-ServerRescueNegativeTestJSON-server-808158946',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-808158946',id=3,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:51:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-v56w4pkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:51:48Z,user_data=None,user_id='889189da060e4b54a48ce9a013e04a3d',uuid=d5c21fac-9fd9-46f8-851e-d1727f5ab0b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "7edd32c8-a71c-4552-bb85-a073a178f87d", "address": "fa:16:3e:8d:3b:63", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7edd32c8-a7", "ovs_interfaceid": "7edd32c8-a71c-4552-bb85-a073a178f87d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3b:63,bridge_name='br-int',has_traffic_filtering=True,id=7edd32c8-a71c-4552-bb85-a073a178f87d,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edd32c8-a7') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG os_vif [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3b:63,bridge_name='br-int',has_traffic_filtering=True,id=7edd32c8-a71c-4552-bb85-a073a178f87d,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edd32c8-a7') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7edd32c8-a7, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:05:47 user nova-compute[82184]: INFO os_vif [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:3b:63,bridge_name='br-int',has_traffic_filtering=True,id=7edd32c8-a71c-4552-bb85-a073a178f87d,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7edd32c8-a7')
Apr 12 02:05:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Deleting instance files /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9_del
Apr 12 02:05:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Deletion of /opt/stack/data/nova/instances/d5c21fac-9fd9-46f8-851e-d1727f5ab0b9_del complete
Apr 12 02:05:47 user nova-compute[82184]: INFO nova.compute.manager [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 02:05:47 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:05:47 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:05:48 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:05:48 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Took 0.62 seconds to deallocate network for instance.
Apr 12 02:05:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-7b408186-f356-49ef-b661-40cee92509fd req-a81e2865-d481-46f8-a35f-f88e69d9ba6a service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-vif-deleted-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:48 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:05:48 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:05:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:48 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Deleted allocations for instance d5c21fac-9fd9-46f8-851e-d1727f5ab0b9
Apr 12 02:05:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ff294fb-42c4-45cb-9e9f-18e3cf47d38d tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.851s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-979aa95a-c72a-43bb-94b4-6e40d77b9c1c req-6ffde510-5ad3-4632-bb97-7f5923cf51c5 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:05:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-979aa95a-c72a-43bb-94b4-6e40d77b9c1c req-6ffde510-5ad3-4632-bb97-7f5923cf51c5 service nova] Acquiring lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-979aa95a-c72a-43bb-94b4-6e40d77b9c1c req-6ffde510-5ad3-4632-bb97-7f5923cf51c5 service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-979aa95a-c72a-43bb-94b4-6e40d77b9c1c req-6ffde510-5ad3-4632-bb97-7f5923cf51c5 service nova] Lock "d5c21fac-9fd9-46f8-851e-d1727f5ab0b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-979aa95a-c72a-43bb-94b4-6e40d77b9c1c req-6ffde510-5ad3-4632-bb97-7f5923cf51c5 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] No waiting events found dispatching network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:05:49 user nova-compute[82184]: WARNING nova.compute.manager [req-979aa95a-c72a-43bb-94b4-6e40d77b9c1c req-6ffde510-5ad3-4632-bb97-7f5923cf51c5 service nova] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Received unexpected event network-vif-plugged-7edd32c8-a71c-4552-bb85-a073a178f87d for instance with vm_state deleted and task_state None.
Apr 12 02:05:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:05:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:05:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:51 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:05:51 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:05:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:05:53 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:05:53 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8285MB free_disk=26.495197296142578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fdbd8add-ac0e-42ce-9b34-5878c6bec208 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 101410fb-7682-46d8-baf1-18fcebf81cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 1a3c868f-3a4c-430e-8009-7a855e832f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2b0bb153-7800-4298-a293-7a2b8cebb194 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:05:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:05:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:05:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:05:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:05:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:05:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:05:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:05:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:05:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:05:59 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:06:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-c8edd239-a625-4c1b-a92f-f07a14ca621b req-6aa3c4a3-3aa0-4553-b2f4-409993fe6e23 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received event network-changed-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-c8edd239-a625-4c1b-a92f-f07a14ca621b req-6aa3c4a3-3aa0-4553-b2f4-409993fe6e23 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Refreshing instance network info cache due to event network-changed-915517f3-521b-4d3a-a7c0-841b64ac50a8. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:06:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c8edd239-a625-4c1b-a92f-f07a14ca621b req-6aa3c4a3-3aa0-4553-b2f4-409993fe6e23 service nova] Acquiring lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:06:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c8edd239-a625-4c1b-a92f-f07a14ca621b req-6aa3c4a3-3aa0-4553-b2f4-409993fe6e23 service nova] Acquired lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:06:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-c8edd239-a625-4c1b-a92f-f07a14ca621b req-6aa3c4a3-3aa0-4553-b2f4-409993fe6e23 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Refreshing network info cache for port 915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:06:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:06:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-c8edd239-a625-4c1b-a92f-f07a14ca621b req-6aa3c4a3-3aa0-4553-b2f4-409993fe6e23 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updated VIF entry in instance network info cache for port 915517f3-521b-4d3a-a7c0-841b64ac50a8. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:06:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-c8edd239-a625-4c1b-a92f-f07a14ca621b req-6aa3c4a3-3aa0-4553-b2f4-409993fe6e23 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updating instance_info_cache with network_info: [{"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:06:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c8edd239-a625-4c1b-a92f-f07a14ca621b req-6aa3c4a3-3aa0-4553-b2f4-409993fe6e23 service nova] Releasing lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:06:02 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265147.7324815, d5c21fac-9fd9-46f8-851e-d1727f5ab0b9 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:06:02 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] VM Stopped (Lifecycle Event)
Apr 12 02:06:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-67335d5f-284a-4170-9aff-a94258addad4 None None] [instance: d5c21fac-9fd9-46f8-851e-d1727f5ab0b9] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:06:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:04 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:06:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:04 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:06:04 user nova-compute[82184]: INFO nova.compute.claims [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Claim successful on node user
Apr 12 02:06:04 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:06:04 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:06:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:04 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG nova.network.neutron [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:06:05 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:06:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:06:05 user nova-compute[82184]: INFO nova.virt.block_device [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Booting with volume 136ed599-e72b-4d77-ad6e-104c14c24194 at /dev/vda
Apr 12 02:06:05 user nova-compute[82184]: DEBUG nova.policy [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8e8b9f0307b4d3fb54d89962798026b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '117589cba4a54dd581f4ec5c26b4cd2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG os_brick.utils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[124e3ca0-6f84-48c3-b2e7-38fa3415dc7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b0f14-0a3d-469d-9c89-345b6223dd8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d2924c-149a-4938-b2b9-395aac749fa7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5301ae87-3e07-4e5d-a66e-398a3a3818be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:06:05 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:06:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fcbeec-2ca6-45b0-b108-1b2e9bb8e2a7]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG os_brick.utils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating existing volume attachment record: 4881a7c0-8e76-4681-8368-f3edea232247 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:06:05 user nova-compute[82184]: DEBUG nova.network.neutron [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Successfully created port: ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:06:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:06 user nova-compute[82184]: DEBUG nova.network.neutron [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Successfully updated port: ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:06:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:06:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:06:06 user nova-compute[82184]: DEBUG nova.network.neutron [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:06:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-374f72bd-aaa1-440b-8df4-a4600ca9cdaa req-148f4b70-3c87-4c1f-8ae4-861fba0b5b00 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-changed-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-374f72bd-aaa1-440b-8df4-a4600ca9cdaa req-148f4b70-3c87-4c1f-8ae4-861fba0b5b00 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Refreshing instance network info cache due to event network-changed-ce1a5774-7c99-4d64-b16b-2dab8491ff6d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:06:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-374f72bd-aaa1-440b-8df4-a4600ca9cdaa req-148f4b70-3c87-4c1f-8ae4-861fba0b5b00 service nova] Acquiring lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:06:06 user nova-compute[82184]: DEBUG nova.network.neutron [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:06:07 user nova-compute[82184]: DEBUG nova.network.neutron [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating instance_info_cache with network_info: [{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:06:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:06:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Instance network_info: |[{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:06:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-374f72bd-aaa1-440b-8df4-a4600ca9cdaa req-148f4b70-3c87-4c1f-8ae4-861fba0b5b00 service nova] Acquired lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:06:07 user nova-compute[82184]: DEBUG nova.network.neutron [req-374f72bd-aaa1-440b-8df4-a4600ca9cdaa req-148f4b70-3c87-4c1f-8ae4-861fba0b5b00 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Refreshing network info cache for port ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:06:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:07 user nova-compute[82184]: DEBUG nova.network.neutron [req-374f72bd-aaa1-440b-8df4-a4600ca9cdaa req-148f4b70-3c87-4c1f-8ae4-861fba0b5b00 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updated VIF entry in instance network info cache for port ce1a5774-7c99-4d64-b16b-2dab8491ff6d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:06:07 user nova-compute[82184]: DEBUG nova.network.neutron [req-374f72bd-aaa1-440b-8df4-a4600ca9cdaa req-148f4b70-3c87-4c1f-8ae4-861fba0b5b00 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating instance_info_cache with network_info: [{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:06:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-374f72bd-aaa1-440b-8df4-a4600ca9cdaa req-148f4b70-3c87-4c1f-8ae4-861fba0b5b00 service nova] Releasing lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:06:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:08 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:06:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:09 user nova-compute[82184]: INFO nova.compute.manager [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attaching volume 44d8159f-7e74-4b7f-9355-a33c1e23d9fd to /dev/vdb
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.utils [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[833f87a7-c51b-42bd-b731-dcfc03d91ba7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[be275f1f-5bdc-48b1-9fcb-cafb4fad9dd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c014d2d-64d5-44fa-a3de-ab571a00b895]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3b2ad8-96ac-400e-b958-d0b60b514edd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:06:09 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f735110e-d0e4-4a72-a334-1cab8b9994b3]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.utils [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updating existing volume attachment record: 15fdf229-0b56-4c32-bf1b-a9f3be640e12 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:06:09 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Creating image(s)
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Ensure instance console log exists: /opt/stack/data/nova/instances/e4ae774a-0f87-4d51-a997-c8f9b228fe71/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Start _get_guest_xml network_info=[{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '4881a7c0-8e76-4681-8368-f3edea232247', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXubagWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4ae774a-0f87-4d51-a997-c8f9b228fe71', 'attached_at': '', 'detached_at': '', 'volume_id': '136ed599-e72b-4d77-ad6e-104c14c24194', 'serial': '136ed599-e72b-4d77-ad6e-104c14c24194'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:06:09 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:06:09 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXubagWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:06:09 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:06:09 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:06:09 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9819b0-7f45-482b-b4f3-3301efa5cc31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:06:09 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed75c443-31f9-41ef-8d07-f5d61e97a6c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194] added
Apr 12 02:06:09 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f624f8d5-d1fe-4349-92b4-74ac119370c3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1543de2-00c4-4230-8c9f-afd81339b9e3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXubagWC {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXubagWC" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13edf67-2497-4cec-a07d-e2f4eb9f1d08]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rXubagWC'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7506fc36-c95e-4516-b738-67ebfd1ae02a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0236db76-a136-40c4-bea3-137b3c5c17d9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:10 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:10 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[072b9595-3c6c-48a5-8d50-9c638dad2a90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260]
Apr 12 02:06:10 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260] successful.
Apr 12 02:06:10 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2444827-1f77-4cea-9707-afb7239cddd7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b84a49f-2328-4f47-b825-cc07d33b4df7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:10 user nova-compute[82184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:06:10 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:10 user nova-compute[82184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:06:10 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf793e45-2baf-4cd8-a7ca-4fdfb3226b00]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXubagWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:10 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:06:10 user nova-compute[82184]: INFO nova.compute.claims [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Claim successful on node user
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26466653738626261', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466653738626261', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1038265517',display_name='tempest-ServerActionsTestJSON-server-1038265517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1038265517',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-ock7vvu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=e4ae774a-0f87-4d51-a997-c8f9b228fe71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ae774a-0f87-4d51-a997-c8f9b228fe71 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:06:11 user nova-compute[82184]:   <uuid>e4ae774a-0f87-4d51-a997-c8f9b228fe71</uuid>
Apr 12 02:06:11 user nova-compute[82184]:   <name>instance-0000001e</name>
Apr 12 02:06:11 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:06:11 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:06:11 user nova-compute[82184]:   <metadata>
Apr 12 02:06:11 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:06:11 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:06:11 user nova-compute[82184]:       <nova:name>tempest-ServerActionsTestJSON-server-1038265517</nova:name>
Apr 12 02:06:11 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:06:09</nova:creationTime>
Apr 12 02:06:11 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:06:11 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:06:11 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:06:11 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:06:11 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:06:11 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:06:11 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:06:11 user nova-compute[82184]:       <nova:owner>
Apr 12 02:06:11 user nova-compute[82184]:         <nova:user uuid="e8e8b9f0307b4d3fb54d89962798026b">tempest-ServerActionsTestJSON-1409832124-project-member</nova:user>
Apr 12 02:06:11 user nova-compute[82184]:         <nova:project uuid="117589cba4a54dd581f4ec5c26b4cd2a">tempest-ServerActionsTestJSON-1409832124</nova:project>
Apr 12 02:06:11 user nova-compute[82184]:       </nova:owner>
Apr 12 02:06:11 user nova-compute[82184]:       <nova:ports>
Apr 12 02:06:11 user nova-compute[82184]:         <nova:port uuid="ce1a5774-7c99-4d64-b16b-2dab8491ff6d">
Apr 12 02:06:11 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 02:06:11 user nova-compute[82184]:         </nova:port>
Apr 12 02:06:11 user nova-compute[82184]:       </nova:ports>
Apr 12 02:06:11 user nova-compute[82184]:     </nova:instance>
Apr 12 02:06:11 user nova-compute[82184]:   </metadata>
Apr 12 02:06:11 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:06:11 user nova-compute[82184]:     <system>
Apr 12 02:06:11 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:06:11 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:06:11 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:06:11 user nova-compute[82184]:       <entry name="serial">e4ae774a-0f87-4d51-a997-c8f9b228fe71</entry>
Apr 12 02:06:11 user nova-compute[82184]:       <entry name="uuid">e4ae774a-0f87-4d51-a997-c8f9b228fe71</entry>
Apr 12 02:06:11 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:06:11 user nova-compute[82184]:     </system>
Apr 12 02:06:11 user nova-compute[82184]:   </sysinfo>
Apr 12 02:06:11 user nova-compute[82184]:   <os>
Apr 12 02:06:11 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:06:11 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:06:11 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:06:11 user nova-compute[82184]:   </os>
Apr 12 02:06:11 user nova-compute[82184]:   <features>
Apr 12 02:06:11 user nova-compute[82184]:     <acpi/>
Apr 12 02:06:11 user nova-compute[82184]:     <apic/>
Apr 12 02:06:11 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:06:11 user nova-compute[82184]:   </features>
Apr 12 02:06:11 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:06:11 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:06:11 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:06:11 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:06:11 user nova-compute[82184]:   </clock>
Apr 12 02:06:11 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:06:11 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:06:11 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:06:11 user nova-compute[82184]:   </cpu>
Apr 12 02:06:11 user nova-compute[82184]:   <devices>
Apr 12 02:06:11 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:06:11 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:06:11 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 02:06:11 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:06:11 user nova-compute[82184]:       <serial>136ed599-e72b-4d77-ad6e-104c14c24194</serial>
Apr 12 02:06:11 user nova-compute[82184]:     </disk>
Apr 12 02:06:11 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:06:11 user nova-compute[82184]:       <mac address="fa:16:3e:70:e2:e8"/>
Apr 12 02:06:11 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:06:11 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:06:11 user nova-compute[82184]:       <target dev="tapce1a5774-7c"/>
Apr 12 02:06:11 user nova-compute[82184]:     </interface>
Apr 12 02:06:11 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:06:11 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/e4ae774a-0f87-4d51-a997-c8f9b228fe71/console.log" append="off"/>
Apr 12 02:06:11 user nova-compute[82184]:     </serial>
Apr 12 02:06:11 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:06:11 user nova-compute[82184]:     <video>
Apr 12 02:06:11 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:06:11 user nova-compute[82184]:     </video>
Apr 12 02:06:11 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:06:11 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:06:11 user nova-compute[82184]:     </rng>
Apr 12 02:06:11 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:06:11 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:06:11 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:06:11 user nova-compute[82184]:     </memballoon>
Apr 12 02:06:11 user nova-compute[82184]:   </devices>
Apr 12 02:06:11 user nova-compute[82184]: </domain>
Apr 12 02:06:11 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1038265517',display_name='tempest-ServerActionsTestJSON-server-1038265517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1038265517',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-ock7vvu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=e4ae774a-0f87-4d51-a997-c8f9b228fe71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG os_vif [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce1a5774-7c, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce1a5774-7c, col_values=(('external_ids', {'iface-id': 'ce1a5774-7c99-4d64-b16b-2dab8491ff6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:e2:e8', 'vm-uuid': 'e4ae774a-0f87-4d51-a997-c8f9b228fe71'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:11 user nova-compute[82184]: INFO os_vif [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c')
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:06:11 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No VIF found with MAC fa:16:3e:70:e2:e8, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:06:11 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Creating image(s)
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "/opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "/opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "/opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.policy [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '189b7aba48014bedacfa021cc3cad5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2acf278c981e481fbe43e415c76aa6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk 1073741824" returned: 0 in 0.059s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:06:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Cannot resize image /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'migration_context' on Instance uuid 34a07ab6-379e-48d9-98ae-c32981534331 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Ensure instance console log exists: /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-adcd4c51-008c-42f4-8be1-d4bab8e64356 req-031cbd5e-c624-42f9-81ce-f66be2e0da90 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-adcd4c51-008c-42f4-8be1-d4bab8e64356 req-031cbd5e-c624-42f9-81ce-f66be2e0da90 service nova] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-adcd4c51-008c-42f4-8be1-d4bab8e64356 req-031cbd5e-c624-42f9-81ce-f66be2e0da90 service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-adcd4c51-008c-42f4-8be1-d4bab8e64356 req-031cbd5e-c624-42f9-81ce-f66be2e0da90 service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-adcd4c51-008c-42f4-8be1-d4bab8e64356 req-031cbd5e-c624-42f9-81ce-f66be2e0da90 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] No waiting events found dispatching network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:06:12 user nova-compute[82184]: WARNING nova.compute.manager [req-adcd4c51-008c-42f4-8be1-d4bab8e64356 req-031cbd5e-c624-42f9-81ce-f66be2e0da90 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received unexpected event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d for instance with vm_state building and task_state spawning.
Apr 12 02:06:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Successfully created port: b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKFdNaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:06:13 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:06:13 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:06:13 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260" returned: 21 in 0.079s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1923ee83-82d7-4a48-80ba-4137f194a96a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:06:13 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c360ad67-515d-40a1-ac0a-2e606b948bc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd] added
Apr 12 02:06:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bdb05f-1cae-4684-858c-b3d9add15d0e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c27198-3d3c-4fbf-b6d5-8a407fbafa6c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRKFdNaI {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YRKFdNaI" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02513bf-5b4f-47a0-b1df-0341a3130e3c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YRKFdNaI'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94173b6-a2ed-4fbd-b80a-9135a5c62387]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9926c51-c013-4c39-b9da-1d2780381875]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:13 user nova-compute[82184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:06:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:13 user nova-compute[82184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:06:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Successfully updated port: b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "refresh_cache-34a07ab6-379e-48d9-98ae-c32981534331" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquired lock "refresh_cache-34a07ab6-379e-48d9-98ae-c32981534331" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-f0176f90-0134-47f0-ab8b-d9b089ef4ffa req-166b577d-9bfb-4e06-afbb-27a620f0e863 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received event network-changed-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-f0176f90-0134-47f0-ab8b-d9b089ef4ffa req-166b577d-9bfb-4e06-afbb-27a620f0e863 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Refreshing instance network info cache due to event network-changed-b7002ebc-047e-4856-bf38-9398ce8b8e6b. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f0176f90-0134-47f0-ab8b-d9b089ef4ffa req-166b577d-9bfb-4e06-afbb-27a620f0e863 service nova] Acquiring lock "refresh_cache-34a07ab6-379e-48d9-98ae-c32981534331" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1bea88-59b8-4d87-8b9c-54942b186f6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd, portal: 172.16.0.220,3260]
Apr 12 02:06:13 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd, portal: 172.16.0.220,3260] successful.
Apr 12 02:06:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b95e34a-cf73-4ff0-be8d-2da583470353]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ae341c-396c-424b-98f4-2001f7a64ad1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:14 user nova-compute[82184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:06:14 user nova-compute[82184]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd (non-flash)
Apr 12 02:06:14 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:14 user nova-compute[82184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:06:14 user nova-compute[82184]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd (non-flash)
Apr 12 02:06:14 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[258f7e0f-6555-4dcc-b124-6cb65365b016]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKFdNaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Updating instance_info_cache with network_info: [{"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Releasing lock "refresh_cache-34a07ab6-379e-48d9-98ae-c32981534331" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Instance network_info: |[{"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f0176f90-0134-47f0-ab8b-d9b089ef4ffa req-166b577d-9bfb-4e06-afbb-27a620f0e863 service nova] Acquired lock "refresh_cache-34a07ab6-379e-48d9-98ae-c32981534331" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.network.neutron [req-f0176f90-0134-47f0-ab8b-d9b089ef4ffa req-166b577d-9bfb-4e06-afbb-27a620f0e863 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Refreshing network info cache for port b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Start _get_guest_xml network_info=[{"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:06:14 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:06:14 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-480594431',display_name='tempest-AttachVolumeNegativeTest-server-480594431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-480594431',id=31,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsML6e7K9uGCYUP4kt9wqcviwiqIOeLK8iydSZvfdudxeVEzsOqCjAyVKD2yM1mhoVoiEzSVXVeJk4zlr5bUmtwCS+FsbuW8X8MAkaRSN0nt1uVNJsz9hu0laZovkkCA==',key_name='tempest-keypair-697615423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-yppa6hyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=34a07ab6-379e-48d9-98ae-c32981534331,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c0:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7002ebc-047e-4856-bf38-9398ce8b8e6b,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7002ebc-04') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'pci_devices' on Instance uuid 34a07ab6-379e-48d9-98ae-c32981534331 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:06:14 user nova-compute[82184]:   <uuid>34a07ab6-379e-48d9-98ae-c32981534331</uuid>
Apr 12 02:06:14 user nova-compute[82184]:   <name>instance-0000001f</name>
Apr 12 02:06:14 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:06:14 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:06:14 user nova-compute[82184]:   <metadata>
Apr 12 02:06:14 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:06:14 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:06:14 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeNegativeTest-server-480594431</nova:name>
Apr 12 02:06:14 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:06:14</nova:creationTime>
Apr 12 02:06:14 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:06:14 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:06:14 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:06:14 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:06:14 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:06:14 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:06:14 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:06:14 user nova-compute[82184]:       <nova:owner>
Apr 12 02:06:14 user nova-compute[82184]:         <nova:user uuid="189b7aba48014bedacfa021cc3cad5e4">tempest-AttachVolumeNegativeTest-1849748479-project-member</nova:user>
Apr 12 02:06:14 user nova-compute[82184]:         <nova:project uuid="2acf278c981e481fbe43e415c76aa6e7">tempest-AttachVolumeNegativeTest-1849748479</nova:project>
Apr 12 02:06:14 user nova-compute[82184]:       </nova:owner>
Apr 12 02:06:14 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:06:14 user nova-compute[82184]:       <nova:ports>
Apr 12 02:06:14 user nova-compute[82184]:         <nova:port uuid="b7002ebc-047e-4856-bf38-9398ce8b8e6b">
Apr 12 02:06:14 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 02:06:14 user nova-compute[82184]:         </nova:port>
Apr 12 02:06:14 user nova-compute[82184]:       </nova:ports>
Apr 12 02:06:14 user nova-compute[82184]:     </nova:instance>
Apr 12 02:06:14 user nova-compute[82184]:   </metadata>
Apr 12 02:06:14 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:06:14 user nova-compute[82184]:     <system>
Apr 12 02:06:14 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:06:14 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:06:14 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:06:14 user nova-compute[82184]:       <entry name="serial">34a07ab6-379e-48d9-98ae-c32981534331</entry>
Apr 12 02:06:14 user nova-compute[82184]:       <entry name="uuid">34a07ab6-379e-48d9-98ae-c32981534331</entry>
Apr 12 02:06:14 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:06:14 user nova-compute[82184]:     </system>
Apr 12 02:06:14 user nova-compute[82184]:   </sysinfo>
Apr 12 02:06:14 user nova-compute[82184]:   <os>
Apr 12 02:06:14 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:06:14 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:06:14 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:06:14 user nova-compute[82184]:   </os>
Apr 12 02:06:14 user nova-compute[82184]:   <features>
Apr 12 02:06:14 user nova-compute[82184]:     <acpi/>
Apr 12 02:06:14 user nova-compute[82184]:     <apic/>
Apr 12 02:06:14 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:06:14 user nova-compute[82184]:   </features>
Apr 12 02:06:14 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:06:14 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:06:14 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:06:14 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:06:14 user nova-compute[82184]:   </clock>
Apr 12 02:06:14 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:06:14 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:06:14 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:06:14 user nova-compute[82184]:   </cpu>
Apr 12 02:06:14 user nova-compute[82184]:   <devices>
Apr 12 02:06:14 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:06:14 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:06:14 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk"/>
Apr 12 02:06:14 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:06:14 user nova-compute[82184]:     </disk>
Apr 12 02:06:14 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:06:14 user nova-compute[82184]:       <mac address="fa:16:3e:b8:c0:ac"/>
Apr 12 02:06:14 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:06:14 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:06:14 user nova-compute[82184]:       <target dev="tapb7002ebc-04"/>
Apr 12 02:06:14 user nova-compute[82184]:     </interface>
Apr 12 02:06:14 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:06:14 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/console.log" append="off"/>
Apr 12 02:06:14 user nova-compute[82184]:     </serial>
Apr 12 02:06:14 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:06:14 user nova-compute[82184]:     <video>
Apr 12 02:06:14 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:06:14 user nova-compute[82184]:     </video>
Apr 12 02:06:14 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:06:14 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:06:14 user nova-compute[82184]:     </rng>
Apr 12 02:06:14 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:06:14 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:06:14 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:06:14 user nova-compute[82184]:     </memballoon>
Apr 12 02:06:14 user nova-compute[82184]:   </devices>
Apr 12 02:06:14 user nova-compute[82184]: </domain>
Apr 12 02:06:14 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-480594431',display_name='tempest-AttachVolumeNegativeTest-server-480594431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-480594431',id=31,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsML6e7K9uGCYUP4kt9wqcviwiqIOeLK8iydSZvfdudxeVEzsOqCjAyVKD2yM1mhoVoiEzSVXVeJk4zlr5bUmtwCS+FsbuW8X8MAkaRSN0nt1uVNJsz9hu0laZovkkCA==',key_name='tempest-keypair-697615423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-yppa6hyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=34a07ab6-379e-48d9-98ae-c32981534331,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c0:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7002ebc-047e-4856-bf38-9398ce8b8e6b,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7002ebc-04') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG os_vif [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c0:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7002ebc-047e-4856-bf38-9398ce8b8e6b,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7002ebc-04') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7002ebc-04, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7002ebc-04, col_values=(('external_ids', {'iface-id': 'b7002ebc-047e-4856-bf38-9398ce8b8e6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:c0:ac', 'vm-uuid': '34a07ab6-379e-48d9-98ae-c32981534331'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:14 user nova-compute[82184]: INFO os_vif [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c0:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7002ebc-047e-4856-bf38-9398ce8b8e6b,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7002ebc-04')
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No VIF found with MAC fa:16:3e:b8:c0:ac, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265174.7879071, e4ae774a-0f87-4d51-a997-c8f9b228fe71 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:06:14 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] VM Resumed (Lifecycle Event)
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:06:14 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Instance spawned successfully.
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:14 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265174.7895708, e4ae774a-0f87-4d51-a997-c8f9b228fe71 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:06:14 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] VM Started (Lifecycle Event)
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-a0bf4e2f-71d7-495c-bea1-2d82bcd89353 req-e8ec28a7-d477-4181-8301-07dc02ecbb0e service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0bf4e2f-71d7-495c-bea1-2d82bcd89353 req-e8ec28a7-d477-4181-8301-07dc02ecbb0e service nova] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0bf4e2f-71d7-495c-bea1-2d82bcd89353 req-e8ec28a7-d477-4181-8301-07dc02ecbb0e service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0bf4e2f-71d7-495c-bea1-2d82bcd89353 req-e8ec28a7-d477-4181-8301-07dc02ecbb0e service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-a0bf4e2f-71d7-495c-bea1-2d82bcd89353 req-e8ec28a7-d477-4181-8301-07dc02ecbb0e service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] No waiting events found dispatching network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:06:14 user nova-compute[82184]: WARNING nova.compute.manager [req-a0bf4e2f-71d7-495c-bea1-2d82bcd89353 req-e8ec28a7-d477-4181-8301-07dc02ecbb0e service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received unexpected event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d for instance with vm_state building and task_state spawning.
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.network.neutron [req-f0176f90-0134-47f0-ab8b-d9b089ef4ffa req-166b577d-9bfb-4e06-afbb-27a620f0e863 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Updated VIF entry in instance network info cache for port b7002ebc-047e-4856-bf38-9398ce8b8e6b. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.network.neutron [req-f0176f90-0134-47f0-ab8b-d9b089ef4ffa req-166b577d-9bfb-4e06-afbb-27a620f0e863 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Updating instance_info_cache with network_info: [{"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:06:14 user nova-compute[82184]: INFO nova.compute.manager [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Took 5.17 seconds to spawn the instance on the hypervisor.
Apr 12 02:06:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:06:14 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:06:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f0176f90-0134-47f0-ab8b-d9b089ef4ffa req-166b577d-9bfb-4e06-afbb-27a620f0e863 service nova] Releasing lock "refresh_cache-34a07ab6-379e-48d9-98ae-c32981534331" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:06:15 user nova-compute[82184]: INFO nova.compute.manager [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Took 10.35 seconds to build instance.
Apr 12 02:06:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a34860b2-273b-4074-81d6-301b70a999f9 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.443s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:06:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23336333636633431', 'path': '/dev/sdd'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:06:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336333636633431', 'path': '/dev/sdd'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:06:15 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:06:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:06:15 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:06:15 user nova-compute[82184]:   <source dev="/dev/sdd"/>
Apr 12 02:06:15 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:06:15 user nova-compute[82184]:   <serial>44d8159f-7e74-4b7f-9355-a33c1e23d9fd</serial>
Apr 12 02:06:15 user nova-compute[82184]: </disk>
Apr 12 02:06:15 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:06:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:06:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:06:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No VIF found with MAC fa:16:3e:e2:49:7f, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:06:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6cbf244e-36df-4591-a235-47135c06c2c7 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.836s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-62742d85-a3c3-412b-a7ab-2c8d1d8dd427 req-ef7eeb73-d638-4c8d-8660-c7c36dcb14f1 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received event network-vif-plugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-62742d85-a3c3-412b-a7ab-2c8d1d8dd427 req-ef7eeb73-d638-4c8d-8660-c7c36dcb14f1 service nova] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-62742d85-a3c3-412b-a7ab-2c8d1d8dd427 req-ef7eeb73-d638-4c8d-8660-c7c36dcb14f1 service nova] Lock "34a07ab6-379e-48d9-98ae-c32981534331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-62742d85-a3c3-412b-a7ab-2c8d1d8dd427 req-ef7eeb73-d638-4c8d-8660-c7c36dcb14f1 service nova] Lock "34a07ab6-379e-48d9-98ae-c32981534331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-62742d85-a3c3-412b-a7ab-2c8d1d8dd427 req-ef7eeb73-d638-4c8d-8660-c7c36dcb14f1 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] No waiting events found dispatching network-vif-plugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:06:16 user nova-compute[82184]: WARNING nova.compute.manager [req-62742d85-a3c3-412b-a7ab-2c8d1d8dd427 req-ef7eeb73-d638-4c8d-8660-c7c36dcb14f1 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received unexpected event network-vif-plugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b for instance with vm_state building and task_state spawning.
Apr 12 02:06:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:17 user nova-compute[82184]: INFO nova.compute.manager [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Detaching volume 44d8159f-7e74-4b7f-9355-a33c1e23d9fd
Apr 12 02:06:17 user nova-compute[82184]: INFO nova.virt.block_device [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attempting to driver detach volume 44d8159f-7e74-4b7f-9355-a33c1e23d9fd from mountpoint /dev/vdb
Apr 12 02:06:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Attempting to detach device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:06:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:06:17 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:06:17 user nova-compute[82184]:   <source dev="/dev/sdd"/>
Apr 12 02:06:17 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:06:17 user nova-compute[82184]:   <serial>44d8159f-7e74-4b7f-9355-a33c1e23d9fd</serial>
Apr 12 02:06:17 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:06:17 user nova-compute[82184]: </disk>
Apr 12 02:06:17 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:06:17 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Successfully detached device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the persistent domain config.
Apr 12 02:06:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:06:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:06:17 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:06:17 user nova-compute[82184]:   <source dev="/dev/sdd"/>
Apr 12 02:06:17 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:06:17 user nova-compute[82184]:   <serial>44d8159f-7e74-4b7f-9355-a33c1e23d9fd</serial>
Apr 12 02:06:17 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:06:17 user nova-compute[82184]: </disk>
Apr 12 02:06:17 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681265178.1049283, 101410fb-7682-46d8-baf1-18fcebf81cb8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:06:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Successfully detached device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the live domain config.
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YRKFdNaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:06:18 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7e9314-4257-4f33-9d32-dc5c2c663d0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:06:18 user nova-compute[82184]: No targets found.
Apr 12 02:06:18 user nova-compute[82184]: iSNS:
Apr 12 02:06:18 user nova-compute[82184]: No targets found.
Apr 12 02:06:18 user nova-compute[82184]: STATIC:
Apr 12 02:06:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194
Apr 12 02:06:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:06:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:06:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd
Apr 12 02:06:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:06:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:06:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28
Apr 12 02:06:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:06:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:06:18 user nova-compute[82184]: FIRMWARE:
Apr 12 02:06:18 user nova-compute[82184]: No targets found.
Apr 12 02:06:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:06:18 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:06:18 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ceeca5-0d02-499c-9776-1fd71499a290]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96679523-896f-4ea4-a88a-56adfa93a191]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:18 user nova-compute[82184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:06:18 user nova-compute[82184]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd (non-flash)
Apr 12 02:06:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:18 user nova-compute[82184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:06:18 user nova-compute[82184]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd (non-flash)
Apr 12 02:06:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b41b6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd'): ({'sdd'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Removing single pathed devices sdd {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a45806-88ef-4e41-92d1-bcfe14172b96]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[281540cf-3e23-42c4-8626-3eb6546e4b6e]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Flushing IO for device /dev/sdd {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cf1b22-4482-4474-84b6-21fd2b9175ee]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e995db26-c949-4af7-acfa-af62be623b42]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1c6ee5-bd6f-4805-b117-0aa601219c09]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c8a101-3414-4295-9d7f-9128052ebbed]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd, portal: 172.16.0.220,3260]
Apr 12 02:06:18 user nova-compute[82184]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd, portal: 172.16.0.220,3260] successful.
Apr 12 02:06:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d8159f-7e74-4b7f-9355-a33c1e23d9fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a08b95-9478-4f77-a5b1-348c0e0e56e2]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== disconnect_volume: return (344ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-11a9c37d-5ad7-4bb1-ae17-976070b62c10 req-5bab0e83-301c-4dc8-8cc2-2a49ac0ac451 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received event network-vif-plugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-11a9c37d-5ad7-4bb1-ae17-976070b62c10 req-5bab0e83-301c-4dc8-8cc2-2a49ac0ac451 service nova] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-11a9c37d-5ad7-4bb1-ae17-976070b62c10 req-5bab0e83-301c-4dc8-8cc2-2a49ac0ac451 service nova] Lock "34a07ab6-379e-48d9-98ae-c32981534331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-11a9c37d-5ad7-4bb1-ae17-976070b62c10 req-5bab0e83-301c-4dc8-8cc2-2a49ac0ac451 service nova] Lock "34a07ab6-379e-48d9-98ae-c32981534331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-11a9c37d-5ad7-4bb1-ae17-976070b62c10 req-5bab0e83-301c-4dc8-8cc2-2a49ac0ac451 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] No waiting events found dispatching network-vif-plugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:06:18 user nova-compute[82184]: WARNING nova.compute.manager [req-11a9c37d-5ad7-4bb1-ae17-976070b62c10 req-5bab0e83-301c-4dc8-8cc2-2a49ac0ac451 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received unexpected event network-vif-plugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b for instance with vm_state building and task_state spawning.
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265178.7934575, 34a07ab6-379e-48d9-98ae-c32981534331 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:06:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] VM Resumed (Lifecycle Event)
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:06:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Instance spawned successfully.
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:06:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265178.797364, 34a07ab6-379e-48d9-98ae-c32981534331 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:06:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] VM Started (Lifecycle Event)
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:06:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:06:18 user nova-compute[82184]: INFO nova.compute.manager [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Took 7.52 seconds to spawn the instance on the hypervisor.
Apr 12 02:06:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:06:19 user nova-compute[82184]: INFO nova.compute.manager [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Took 8.16 seconds to build instance.
Apr 12 02:06:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4130470f-4960-4c93-9d11-e95360d6bc12 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.261s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:06:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4a2b7c53-e3c8-447f-8203-893adfbbd45f tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.075s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 1a3c868f-3a4c-430e-8009-7a855e832f82 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 2b0bb153-7800-4298-a293-7a2b8cebb194 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid e4ae774a-0f87-4d51-a997-c8f9b228fe71 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 34a07ab6-379e-48d9-98ae-c32981534331 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "1a3c868f-3a4c-430e-8009-7a855e832f82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "2b0bb153-7800-4298-a293-7a2b8cebb194" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "34a07ab6-379e-48d9-98ae-c32981534331" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "34a07ab6-379e-48d9-98ae-c32981534331" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:06:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:06:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:06:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:06:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:37 user nova-compute[82184]: INFO nova.compute.manager [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Terminating instance
Apr 12 02:06:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-fe50a543-914a-4195-b731-3bd47a2746df req-7018cadb-f021-488c-a7f5-d077459c5ea4 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-unplugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fe50a543-914a-4195-b731-3bd47a2746df req-7018cadb-f021-488c-a7f5-d077459c5ea4 service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fe50a543-914a-4195-b731-3bd47a2746df req-7018cadb-f021-488c-a7f5-d077459c5ea4 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fe50a543-914a-4195-b731-3bd47a2746df req-7018cadb-f021-488c-a7f5-d077459c5ea4 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-fe50a543-914a-4195-b731-3bd47a2746df req-7018cadb-f021-488c-a7f5-d077459c5ea4 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-unplugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-fe50a543-914a-4195-b731-3bd47a2746df req-7018cadb-f021-488c-a7f5-d077459c5ea4 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-unplugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "2b0bb153-7800-4298-a293-7a2b8cebb194" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:37 user nova-compute[82184]: INFO nova.compute.manager [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Terminating instance
Apr 12 02:06:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Instance destroyed successfully.
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lazy-loading 'resources' on Instance uuid fdbd8add-ac0e-42ce-9b34-5878c6bec208 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T01:49:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-722086832',display_name='tempest-ServerRescueNegativeTestJSON-server-722086832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-722086832',id=1,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T01:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8fed0886b2404f41a659dc6356771e9c',ramdisk_id='',reservation_id='r-mzuyr7dh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-502185932',owner_user_name='tempest-ServerRescueNegativeTestJSON-502185932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T01:56:30Z,user_data=None,user_id='889189da060e4b54a48ce9a013e04a3d',uuid=fdbd8add-ac0e-42ce-9b34-5878c6bec208,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converting VIF {"id": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "address": "fa:16:3e:59:1d:2d", "network": {"id": "babcad8e-dca2-47b4-80af-a9e0cede0853", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1945081594-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8fed0886b2404f41a659dc6356771e9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf0cfa6a-43", "ovs_interfaceid": "af0cfa6a-437f-4754-87f3-f5715490cbbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=af0cfa6a-437f-4754-87f3-f5715490cbbf,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0cfa6a-43') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_vif [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=af0cfa6a-437f-4754-87f3-f5715490cbbf,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0cfa6a-43') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf0cfa6a-43, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: INFO os_vif [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:1d:2d,bridge_name='br-int',has_traffic_filtering=True,id=af0cfa6a-437f-4754-87f3-f5715490cbbf,network=Network(babcad8e-dca2-47b4-80af-a9e0cede0853),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf0cfa6a-43')
Apr 12 02:06:38 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Deleting instance files /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208_del
Apr 12 02:06:38 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Deletion of /opt/stack/data/nova/instances/fdbd8add-ac0e-42ce-9b34-5878c6bec208_del complete
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-627db1be-0c19-470a-a681-94266c972f24 req-4088b88b-66ce-49a1-b04c-38abaf3fe3b0 service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Received event network-vif-unplugged-0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-627db1be-0c19-470a-a681-94266c972f24 req-4088b88b-66ce-49a1-b04c-38abaf3fe3b0 service nova] Acquiring lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-627db1be-0c19-470a-a681-94266c972f24 req-4088b88b-66ce-49a1-b04c-38abaf3fe3b0 service nova] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-627db1be-0c19-470a-a681-94266c972f24 req-4088b88b-66ce-49a1-b04c-38abaf3fe3b0 service nova] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-627db1be-0c19-470a-a681-94266c972f24 req-4088b88b-66ce-49a1-b04c-38abaf3fe3b0 service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] No waiting events found dispatching network-vif-unplugged-0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-627db1be-0c19-470a-a681-94266c972f24 req-4088b88b-66ce-49a1-b04c-38abaf3fe3b0 service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Received event network-vif-unplugged-0741e554-620f-442e-b359-4d2c83da491a for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:06:38 user nova-compute[82184]: INFO nova.compute.manager [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:06:38 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Instance destroyed successfully.
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.objects.instance [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'resources' on Instance uuid 2b0bb153-7800-4298-a293-7a2b8cebb194 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:04:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1161614728',display_name='tempest-TestVolumeBootPattern-server-1161614728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1161614728',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:05:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-gnsiy22n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:05:04Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=2b0bb153-7800-4298-a293-7a2b8cebb194,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0741e554-620f-442e-b359-4d2c83da491a", "address": "fa:16:3e:96:72:be", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0741e554-62", "ovs_interfaceid": "0741e554-620f-442e-b359-4d2c83da491a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "0741e554-620f-442e-b359-4d2c83da491a", "address": "fa:16:3e:96:72:be", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0741e554-62", "ovs_interfaceid": "0741e554-620f-442e-b359-4d2c83da491a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:72:be,bridge_name='br-int',has_traffic_filtering=True,id=0741e554-620f-442e-b359-4d2c83da491a,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0741e554-62') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_vif [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:72:be,bridge_name='br-int',has_traffic_filtering=True,id=0741e554-620f-442e-b359-4d2c83da491a,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0741e554-62') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0741e554-62, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:06:38 user nova-compute[82184]: INFO os_vif [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:72:be,bridge_name='br-int',has_traffic_filtering=True,id=0741e554-620f-442e-b359-4d2c83da491a,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0741e554-62')
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTgeoCyi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:06:38 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7251ade-1e8a-4be3-a3f5-39a7db84e2f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:06:38 user nova-compute[82184]: No targets found.
Apr 12 02:06:38 user nova-compute[82184]: iSNS:
Apr 12 02:06:38 user nova-compute[82184]: No targets found.
Apr 12 02:06:38 user nova-compute[82184]: STATIC:
Apr 12 02:06:38 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194
Apr 12 02:06:38 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:06:38 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:06:38 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28
Apr 12 02:06:38 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:06:38 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:06:38 user nova-compute[82184]: FIRMWARE:
Apr 12 02:06:38 user nova-compute[82184]: No targets found.
Apr 12 02:06:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:06:38 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:06:38 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ed1a05-bcb8-4ff8-b76f-e7b17182ce8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91be178-caf2-4b81-b1a3-b571ac6402cb]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:38 user nova-compute[82184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:06:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 (non-flash)
Apr 12 02:06:38 user nova-compute[82184]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:06:38 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a8328c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28'): ({'sdc'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Removing single pathed devices sdc {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f27dc67-3860-469a-b3e0-4147ac281cc6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[15187edd-2f53-4b8c-a9a3-93e49b4918f1]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flushing IO for device /dev/sdc {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:38 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Took 0.64 seconds to deallocate network for instance.
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecf4909-1cbe-4fda-80c1-f830f8bb4eab]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a8b7f3-4c7c-4b7a-82fa-4396b4bf40ad]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23664633332313537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d4970655', '/dev/disk/by-id/scsi-1SCST_BIOd4970655-6dc3215760527cf8') {{(pid=92498) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec000b5-93c6-4b75-abf9-cd5ab7b115e5]: (4, None) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:06:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af07433-9f77-438b-b2b2-63ed1118bb3a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[193688a5-edfb-4fb6-a610-4ac54dd65625]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28, portal: 172.16.0.220,3260]
Apr 12 02:06:39 user nova-compute[82184]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28, portal: 172.16.0.220,3260] successful.
Apr 12 02:06:39 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c271b093-8900-41a9-ad42-5c49a78dfd28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58a11af-a7f0-4902-9ac7-e0398d303687]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== disconnect_volume: return (344ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:06:39 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Deleting instance files /opt/stack/data/nova/instances/2b0bb153-7800-4298-a293-7a2b8cebb194_del
Apr 12 02:06:39 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Deletion of /opt/stack/data/nova/instances/2b0bb153-7800-4298-a293-7a2b8cebb194_del complete
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:06:39 user nova-compute[82184]: INFO nova.compute.manager [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:39 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Deleted allocations for instance fdbd8add-ac0e-42ce-9b34-5878c6bec208
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b69a061e-6367-41d0-808f-bd096f5d429a tempest-ServerRescueNegativeTestJSON-502185932 tempest-ServerRescueNegativeTestJSON-502185932-project-member] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.005s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:06:39 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Took 0.46 seconds to deallocate network for instance.
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-f59ddf3d-de30-4e97-8955-c56010cf0806 req-22ce353d-fb2b-4160-86a7-67e856aba4d5 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f59ddf3d-de30-4e97-8955-c56010cf0806 req-22ce353d-fb2b-4160-86a7-67e856aba4d5 service nova] Acquiring lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f59ddf3d-de30-4e97-8955-c56010cf0806 req-22ce353d-fb2b-4160-86a7-67e856aba4d5 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f59ddf3d-de30-4e97-8955-c56010cf0806 req-22ce353d-fb2b-4160-86a7-67e856aba4d5 service nova] Lock "fdbd8add-ac0e-42ce-9b34-5878c6bec208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-f59ddf3d-de30-4e97-8955-c56010cf0806 req-22ce353d-fb2b-4160-86a7-67e856aba4d5 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] No waiting events found dispatching network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:06:39 user nova-compute[82184]: WARNING nova.compute.manager [req-f59ddf3d-de30-4e97-8955-c56010cf0806 req-22ce353d-fb2b-4160-86a7-67e856aba4d5 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received unexpected event network-vif-plugged-af0cfa6a-437f-4754-87f3-f5715490cbbf for instance with vm_state deleted and task_state None.
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-f59ddf3d-de30-4e97-8955-c56010cf0806 req-22ce353d-fb2b-4160-86a7-67e856aba4d5 service nova] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Received event network-vif-deleted-af0cfa6a-437f-4754-87f3-f5715490cbbf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-f59ddf3d-de30-4e97-8955-c56010cf0806 req-22ce353d-fb2b-4160-86a7-67e856aba4d5 service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Received event network-vif-deleted-0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-cc93f823-2783-47f7-a0a4-66ae59c5bac1 req-057fc49a-a78a-4a1f-9570-5f518552e4b1 service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Received event network-vif-plugged-0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:06:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cc93f823-2783-47f7-a0a4-66ae59c5bac1 req-057fc49a-a78a-4a1f-9570-5f518552e4b1 service nova] Acquiring lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cc93f823-2783-47f7-a0a4-66ae59c5bac1 req-057fc49a-a78a-4a1f-9570-5f518552e4b1 service nova] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cc93f823-2783-47f7-a0a4-66ae59c5bac1 req-057fc49a-a78a-4a1f-9570-5f518552e4b1 service nova] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-cc93f823-2783-47f7-a0a4-66ae59c5bac1 req-057fc49a-a78a-4a1f-9570-5f518552e4b1 service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] No waiting events found dispatching network-vif-plugged-0741e554-620f-442e-b359-4d2c83da491a {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:06:40 user nova-compute[82184]: WARNING nova.compute.manager [req-cc93f823-2783-47f7-a0a4-66ae59c5bac1 req-057fc49a-a78a-4a1f-9570-5f518552e4b1 service nova] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Received unexpected event network-vif-plugged-0741e554-620f-442e-b359-4d2c83da491a for instance with vm_state active and task_state deleting.
Apr 12 02:06:40 user nova-compute[82184]: INFO nova.compute.manager [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Took 0.82 seconds to detach 1 volumes for instance.
Apr 12 02:06:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Deleting volume: c271b093-8900-41a9-ad42-5c49a78dfd28 {{(pid=82184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 02:06:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:40 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:06:40 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:06:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:40 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Deleted allocations for instance 2b0bb153-7800-4298-a293-7a2b8cebb194
Apr 12 02:06:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5fbca1a7-d5ef-4404-87e7-b219f4ab7c2f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2b0bb153-7800-4298-a293-7a2b8cebb194" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.941s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:52 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:06:52 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:06:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:52 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:06:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265198.1461325, fdbd8add-ac0e-42ce-9b34-5878c6bec208 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:06:53 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] VM Stopped (Lifecycle Event)
Apr 12 02:06:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5d02bc16-68ac-499c-be87-694a80e50e65 None None] [instance: fdbd8add-ac0e-42ce-9b34-5878c6bec208] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265198.7051158, 2b0bb153-7800-4298-a293-7a2b8cebb194 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:06:53 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] VM Stopped (Lifecycle Event)
Apr 12 02:06:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d50038d5-b82d-4e8c-ba32-0a6033dae40f None None] [instance: 2b0bb153-7800-4298-a293-7a2b8cebb194] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:06:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:06:54 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:06:54 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:06:54 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8344MB free_disk=26.482250213623047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 101410fb-7682-46d8-baf1-18fcebf81cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 1a3c868f-3a4c-430e-8009-7a855e832f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e4ae774a-0f87-4d51-a997-c8f9b228fe71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 34a07ab6-379e-48d9-98ae-c32981534331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:06:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updating instance_info_cache with network_info: [{"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:06:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:06:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:06:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:07:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:07:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:07:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:07:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:07:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:07:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:07:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:07:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:07:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG nova.objects.instance [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:10 user nova-compute[82184]: INFO nova.compute.manager [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attaching volume 9ab4d808-467b-4974-b606-a8029e17b183 to /dev/vdb
Apr 12 02:07:10 user nova-compute[82184]: DEBUG os_brick.utils [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaff347-383c-47e1-a21d-63c80fe89078]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd90fe7f-c2f0-4e36-964b-e49851cdad65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd5a44c-4a2b-4212-9bf4-7af33cd936e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6994d4-1ac3-4710-867e-70af75ddef4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:07:10 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:07:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ed381e-ba5c-4c80-a150-af25eb8e9330]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG os_brick.utils [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:07:10 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updating existing volume attachment record: cb9253b6-c71f-47b9-8f69-4dac4096aaf9 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:07:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOVfCINn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:07:14 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:07:14 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:07:14 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[717d49d2-df54-4652-9e65-e938c28c6716]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:07:14 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b5937d-ac85-4d9f-9f09-99269d2b1585]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183] added
Apr 12 02:07:14 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e9a89b-edaf-4955-9119-367b4771b187]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27998725-cfb0-4daf-a0bd-e0c78fd9c706]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOVfCINn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOVfCINn" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd86659-200c-43ca-8a70-20dc7176b40f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QOVfCINn'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8446f249-54a4-4248-b161-8b7d0a82b593]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[509db066-30a1-4636-a8fe-506f23176d25]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:07:14 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:07:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:07:14 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[15590a07-88fd-41d3-aa1b-725aaf4bdef6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183, portal: 172.16.0.220,3260]
Apr 12 02:07:15 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183, portal: 172.16.0.220,3260] successful.
Apr 12 02:07:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[151daffd-9dd9-4858-9df1-19fdbd7a7a53]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ba0e2a-86ae-4403-811c-14cc2396f184]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:07:15 user nova-compute[82184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 (non-flash)
Apr 12 02:07:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:07:15 user nova-compute[82184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 (non-flash)
Apr 12 02:07:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[310d3ed7-6350-4f5a-9797-521e11c05957]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:15 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOVfCINn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23536356634366463', 'path': '/dev/sdc'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536356634366463', 'path': '/dev/sdc'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG nova.objects.instance [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:07:16 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:07:16 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 02:07:16 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:07:16 user nova-compute[82184]:   <serial>9ab4d808-467b-4974-b606-a8029e17b183</serial>
Apr 12 02:07:16 user nova-compute[82184]: </disk>
Apr 12 02:07:16 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No VIF found with MAC fa:16:3e:e2:49:7f, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-71789377-f12c-43cb-9af0-d73239d643fc tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.114s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:17 user nova-compute[82184]: INFO nova.compute.manager [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Detaching volume 9ab4d808-467b-4974-b606-a8029e17b183
Apr 12 02:07:17 user nova-compute[82184]: INFO nova.virt.block_device [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attempting to driver detach volume 9ab4d808-467b-4974-b606-a8029e17b183 from mountpoint /dev/vdb
Apr 12 02:07:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Attempting to detach device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:07:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:07:17 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:07:17 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 02:07:17 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:07:17 user nova-compute[82184]:   <serial>9ab4d808-467b-4974-b606-a8029e17b183</serial>
Apr 12 02:07:17 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:07:17 user nova-compute[82184]: </disk>
Apr 12 02:07:17 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:07:17 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Successfully detached device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the persistent domain config.
Apr 12 02:07:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:07:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:07:17 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:07:17 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 02:07:17 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:07:17 user nova-compute[82184]:   <serial>9ab4d808-467b-4974-b606-a8029e17b183</serial>
Apr 12 02:07:17 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:07:17 user nova-compute[82184]: </disk>
Apr 12 02:07:17 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681265238.0564249, 101410fb-7682-46d8-baf1-18fcebf81cb8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:07:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Successfully detached device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the live domain config.
Apr 12 02:07:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOVfCINn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:07:18 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1eb565-35e1-424b-9eb8-bd1665c030ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:07:18 user nova-compute[82184]: No targets found.
Apr 12 02:07:18 user nova-compute[82184]: iSNS:
Apr 12 02:07:18 user nova-compute[82184]: No targets found.
Apr 12 02:07:18 user nova-compute[82184]: STATIC:
Apr 12 02:07:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194
Apr 12 02:07:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:07:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:07:18 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183
Apr 12 02:07:18 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:07:18 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:07:18 user nova-compute[82184]: FIRMWARE:
Apr 12 02:07:18 user nova-compute[82184]: No targets found.
Apr 12 02:07:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:07:18 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:07:18 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1123c459-def2-43cd-8528-305afd2b7bc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67bd658-0537-4438-a17b-9a480975cbf8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:07:18 user nova-compute[82184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 (non-flash)
Apr 12 02:07:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:07:18 user nova-compute[82184]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 (non-flash)
Apr 12 02:07:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2688235900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183'): ({'sdc'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Removing single pathed devices sdc {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f5af6b-843b-4598-ac6f-a2fce2c75841]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e12e5b-38fd-4757-b3a0-762b4a013cec]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Flushing IO for device /dev/sdc {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[914ad1ac-16cd-443c-8693-6d901265ebd3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df5a69e-f5a2-4fe3-a3fa-3381c8e469fb]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ff422d-f1c5-4cd2-bbab-e79aef078040]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5554efc3-6dc9-4db2-b093-06deab52e519]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183, portal: 172.16.0.220,3260]
Apr 12 02:07:18 user nova-compute[82184]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183, portal: 172.16.0.220,3260] successful.
Apr 12 02:07:18 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ab4d808-467b-4974-b606-a8029e17b183 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[137880b1-d435-4b2b-986d-0ac0421d6f7b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== disconnect_volume: return (288ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:07:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:07:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e49c3e81-c720-4b3b-8dd9-efd83fb31000 tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:07:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:07:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:07:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:07:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:07:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:35 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:07:35 user nova-compute[82184]: INFO nova.compute.claims [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Claim successful on node user
Apr 12 02:07:35 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:07:36 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:07:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:07:36 user nova-compute[82184]: INFO nova.virt.block_device [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Booting with volume a91e0965-aef8-40da-921c-cd9566b59a98 at /dev/vda
Apr 12 02:07:36 user nova-compute[82184]: DEBUG nova.policy [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d5d81fffb14b1cab84b6160ceb7dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd685278576490480a97cd2bc5e048b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG os_brick.utils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe875f9-8139-4023-89d0-346b3aaa8276]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5a6222-a9db-4cea-8562-6801e34ac428]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab92afab-2718-466d-a3aa-c5c8fb181edf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4632f607-6c78-43f9-82d7-a3e526494ac4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:07:36 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:07:36 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af8c697-1acf-4577-85ab-102bfb266f1b]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG os_brick.utils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Updating existing volume attachment record: bfdcdde1-b1b9-4ec9-bc75-72d55f6f98ee {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:36 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Successfully created port: e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:07:37 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Successfully updated port: e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:07:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "refresh_cache-fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:07:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquired lock "refresh_cache-fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:07:37 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:07:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-0b4d6a62-d685-4c85-b90a-942da6a336f2 req-152f6d12-fd98-4d36-a9df-b6a1cd74916c service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Received event network-changed-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:07:37 user nova-compute[82184]: DEBUG nova.compute.manager [req-0b4d6a62-d685-4c85-b90a-942da6a336f2 req-152f6d12-fd98-4d36-a9df-b6a1cd74916c service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Refreshing instance network info cache due to event network-changed-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:07:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0b4d6a62-d685-4c85-b90a-942da6a336f2 req-152f6d12-fd98-4d36-a9df-b6a1cd74916c service nova] Acquiring lock "refresh_cache-fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:07:37 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:07:38 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Updating instance_info_cache with network_info: [{"id": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "address": "fa:16:3e:ce:1f:3e", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7679d13-0b", "ovs_interfaceid": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:07:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Releasing lock "refresh_cache-fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:07:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Instance network_info: |[{"id": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "address": "fa:16:3e:ce:1f:3e", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7679d13-0b", "ovs_interfaceid": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:07:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0b4d6a62-d685-4c85-b90a-942da6a336f2 req-152f6d12-fd98-4d36-a9df-b6a1cd74916c service nova] Acquired lock "refresh_cache-fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:07:38 user nova-compute[82184]: DEBUG nova.network.neutron [req-0b4d6a62-d685-4c85-b90a-942da6a336f2 req-152f6d12-fd98-4d36-a9df-b6a1cd74916c service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Refreshing network info cache for port e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:07:38 user nova-compute[82184]: DEBUG nova.network.neutron [req-0b4d6a62-d685-4c85-b90a-942da6a336f2 req-152f6d12-fd98-4d36-a9df-b6a1cd74916c service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Updated VIF entry in instance network info cache for port e7679d13-0bc6-48e2-83ad-5a1c9fe8445c. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:07:38 user nova-compute[82184]: DEBUG nova.network.neutron [req-0b4d6a62-d685-4c85-b90a-942da6a336f2 req-152f6d12-fd98-4d36-a9df-b6a1cd74916c service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Updating instance_info_cache with network_info: [{"id": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "address": "fa:16:3e:ce:1f:3e", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7679d13-0b", "ovs_interfaceid": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:07:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0b4d6a62-d685-4c85-b90a-942da6a336f2 req-152f6d12-fd98-4d36-a9df-b6a1cd74916c service nova] Releasing lock "refresh_cache-fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:07:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:07:41 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Creating image(s)
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Ensure instance console log exists: /opt/stack/data/nova/instances/fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Start _get_guest_xml network_info=[{"id": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "address": "fa:16:3e:ce:1f:3e", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7679d13-0b", "ovs_interfaceid": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'bfdcdde1-b1b9-4ec9-bc75-72d55f6f98ee', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjulQIFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a91e0965-aef8-40da-921c-cd9566b59a98', 'serial': 'a91e0965-aef8-40da-921c-cd9566b59a98'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:07:41 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:07:41 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjulQIFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:07:41 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:07:41 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:07:41 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f335bf-64b7-471f-bd0a-9be1f44eb8b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:07:41 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e0267d-ccf7-472e-b86c-6b376e09ba28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98] added
Apr 12 02:07:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74197c52-832d-4e6b-b3f0-db64477ab05f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[601784b7-96c3-48c9-b786-fdb112105759]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjulQIFh {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kjulQIFh" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[950af248-275d-4082-8f4a-85b80810f754]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kjulQIFh'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8769e54a-4e15-4294-b0eb-32b7faaae7bf]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c1c78f-237c-4258-bc8b-cdf014cff15b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:07:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:07:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[52001973-0d5f-469f-b897-d5ba7242e314]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98, portal: 172.16.0.220,3260]
Apr 12 02:07:41 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98, portal: 172.16.0.220,3260] successful.
Apr 12 02:07:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f837ab6-31a2-4bad-a5b2-957743fbb21a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f57f724-b63a-4a6b-9f99-ef66bf25e16a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:07:41 user nova-compute[82184]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:07:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:07:41 user nova-compute[82184]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:07:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bab7fc9-b37b-4a09-8d7e-005510005496]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:07:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjulQIFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23439356132383534', 'path': '/dev/sdc'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439356132383534', 'path': '/dev/sdc'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1293359077',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1293359077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1293359077',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-2793540h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:07:36Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "address": "fa:16:3e:ce:1f:3e", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7679d13-0b", "ovs_interfaceid": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "address": "fa:16:3e:ce:1f:3e", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7679d13-0b", "ovs_interfaceid": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1f:3e,bridge_name='br-int',has_traffic_filtering=True,id=e7679d13-0bc6-48e2-83ad-5a1c9fe8445c,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7679d13-0b') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.objects.instance [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'pci_devices' on Instance uuid fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:07:42 user nova-compute[82184]:   <uuid>fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c</uuid>
Apr 12 02:07:42 user nova-compute[82184]:   <name>instance-00000020</name>
Apr 12 02:07:42 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:07:42 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:07:42 user nova-compute[82184]:   <metadata>
Apr 12 02:07:42 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:07:42 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:07:42 user nova-compute[82184]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1293359077</nova:name>
Apr 12 02:07:42 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:07:41</nova:creationTime>
Apr 12 02:07:42 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:07:42 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:07:42 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:07:42 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:07:42 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:07:42 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:07:42 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:07:42 user nova-compute[82184]:       <nova:owner>
Apr 12 02:07:42 user nova-compute[82184]:         <nova:user uuid="69d5d81fffb14b1cab84b6160ceb7dd2">tempest-TestVolumeBootPattern-2043953815-project-member</nova:user>
Apr 12 02:07:42 user nova-compute[82184]:         <nova:project uuid="bcd685278576490480a97cd2bc5e048b">tempest-TestVolumeBootPattern-2043953815</nova:project>
Apr 12 02:07:42 user nova-compute[82184]:       </nova:owner>
Apr 12 02:07:42 user nova-compute[82184]:       <nova:ports>
Apr 12 02:07:42 user nova-compute[82184]:         <nova:port uuid="e7679d13-0bc6-48e2-83ad-5a1c9fe8445c">
Apr 12 02:07:42 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 02:07:42 user nova-compute[82184]:         </nova:port>
Apr 12 02:07:42 user nova-compute[82184]:       </nova:ports>
Apr 12 02:07:42 user nova-compute[82184]:     </nova:instance>
Apr 12 02:07:42 user nova-compute[82184]:   </metadata>
Apr 12 02:07:42 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:07:42 user nova-compute[82184]:     <system>
Apr 12 02:07:42 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:07:42 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:07:42 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:07:42 user nova-compute[82184]:       <entry name="serial">fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c</entry>
Apr 12 02:07:42 user nova-compute[82184]:       <entry name="uuid">fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c</entry>
Apr 12 02:07:42 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:07:42 user nova-compute[82184]:     </system>
Apr 12 02:07:42 user nova-compute[82184]:   </sysinfo>
Apr 12 02:07:42 user nova-compute[82184]:   <os>
Apr 12 02:07:42 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:07:42 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:07:42 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:07:42 user nova-compute[82184]:   </os>
Apr 12 02:07:42 user nova-compute[82184]:   <features>
Apr 12 02:07:42 user nova-compute[82184]:     <acpi/>
Apr 12 02:07:42 user nova-compute[82184]:     <apic/>
Apr 12 02:07:42 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:07:42 user nova-compute[82184]:   </features>
Apr 12 02:07:42 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:07:42 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:07:42 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:07:42 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:07:42 user nova-compute[82184]:   </clock>
Apr 12 02:07:42 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:07:42 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:07:42 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:07:42 user nova-compute[82184]:   </cpu>
Apr 12 02:07:42 user nova-compute[82184]:   <devices>
Apr 12 02:07:42 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:07:42 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:07:42 user nova-compute[82184]:       <source dev="/dev/sdc"/>
Apr 12 02:07:42 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:07:42 user nova-compute[82184]:       <serial>a91e0965-aef8-40da-921c-cd9566b59a98</serial>
Apr 12 02:07:42 user nova-compute[82184]:     </disk>
Apr 12 02:07:42 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:07:42 user nova-compute[82184]:       <mac address="fa:16:3e:ce:1f:3e"/>
Apr 12 02:07:42 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:07:42 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:07:42 user nova-compute[82184]:       <target dev="tape7679d13-0b"/>
Apr 12 02:07:42 user nova-compute[82184]:     </interface>
Apr 12 02:07:42 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:07:42 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c/console.log" append="off"/>
Apr 12 02:07:42 user nova-compute[82184]:     </serial>
Apr 12 02:07:42 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:07:42 user nova-compute[82184]:     <video>
Apr 12 02:07:42 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:07:42 user nova-compute[82184]:     </video>
Apr 12 02:07:42 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:07:42 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:07:42 user nova-compute[82184]:     </rng>
Apr 12 02:07:42 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:07:42 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:07:42 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:07:42 user nova-compute[82184]:     </memballoon>
Apr 12 02:07:42 user nova-compute[82184]:   </devices>
Apr 12 02:07:42 user nova-compute[82184]: </domain>
Apr 12 02:07:42 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1293359077',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1293359077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1293359077',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-2793540h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:07:36Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "address": "fa:16:3e:ce:1f:3e", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7679d13-0b", "ovs_interfaceid": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "address": "fa:16:3e:ce:1f:3e", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7679d13-0b", "ovs_interfaceid": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1f:3e,bridge_name='br-int',has_traffic_filtering=True,id=e7679d13-0bc6-48e2-83ad-5a1c9fe8445c,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7679d13-0b') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG os_vif [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1f:3e,bridge_name='br-int',has_traffic_filtering=True,id=e7679d13-0bc6-48e2-83ad-5a1c9fe8445c,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7679d13-0b') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7679d13-0b, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7679d13-0b, col_values=(('external_ids', {'iface-id': 'e7679d13-0bc6-48e2-83ad-5a1c9fe8445c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:1f:3e', 'vm-uuid': 'fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:42 user nova-compute[82184]: INFO os_vif [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1f:3e,bridge_name='br-int',has_traffic_filtering=True,id=e7679d13-0bc6-48e2-83ad-5a1c9fe8445c,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7679d13-0b')
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:07:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No VIF found with MAC fa:16:3e:ce:1f:3e, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:07:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-26694122-9304-4f18-a775-ae722abaace1 req-e5f55646-5d50-4c34-b1e4-72dfc16a846a service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Received event network-vif-plugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:07:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-26694122-9304-4f18-a775-ae722abaace1 req-e5f55646-5d50-4c34-b1e4-72dfc16a846a service nova] Acquiring lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-26694122-9304-4f18-a775-ae722abaace1 req-e5f55646-5d50-4c34-b1e4-72dfc16a846a service nova] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-26694122-9304-4f18-a775-ae722abaace1 req-e5f55646-5d50-4c34-b1e4-72dfc16a846a service nova] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-26694122-9304-4f18-a775-ae722abaace1 req-e5f55646-5d50-4c34-b1e4-72dfc16a846a service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] No waiting events found dispatching network-vif-plugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:07:44 user nova-compute[82184]: WARNING nova.compute.manager [req-26694122-9304-4f18-a775-ae722abaace1 req-e5f55646-5d50-4c34-b1e4-72dfc16a846a service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Received unexpected event network-vif-plugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c for instance with vm_state building and task_state spawning.
Apr 12 02:07:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265266.3515785, fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:07:46 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] VM Resumed (Lifecycle Event)
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:07:46 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Instance spawned successfully.
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:07:46 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265266.3555386, fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:07:46 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] VM Started (Lifecycle Event)
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:07:46 user nova-compute[82184]: INFO nova.compute.manager [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Took 5.02 seconds to spawn the instance on the hypervisor.
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:07:46 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-da3de871-e045-4087-8e37-f85bffa4649b req-15b3c14e-d19b-4c78-a402-3d465848a048 service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Received event network-vif-plugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da3de871-e045-4087-8e37-f85bffa4649b req-15b3c14e-d19b-4c78-a402-3d465848a048 service nova] Acquiring lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da3de871-e045-4087-8e37-f85bffa4649b req-15b3c14e-d19b-4c78-a402-3d465848a048 service nova] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-da3de871-e045-4087-8e37-f85bffa4649b req-15b3c14e-d19b-4c78-a402-3d465848a048 service nova] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-da3de871-e045-4087-8e37-f85bffa4649b req-15b3c14e-d19b-4c78-a402-3d465848a048 service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] No waiting events found dispatching network-vif-plugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:07:46 user nova-compute[82184]: WARNING nova.compute.manager [req-da3de871-e045-4087-8e37-f85bffa4649b req-15b3c14e-d19b-4c78-a402-3d465848a048 service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Received unexpected event network-vif-plugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c for instance with vm_state building and task_state spawning.
Apr 12 02:07:46 user nova-compute[82184]: INFO nova.compute.manager [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Took 10.81 seconds to build instance.
Apr 12 02:07:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0323eeea-ce23-4468-ad8f-eb0ea0c399eb tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.906s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:07:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:07:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:07:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:07:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:07:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updating instance_info_cache with network_info: [{"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-feaf7e49-3470-4480-83e8-1da4370ec780 req-8201aeda-5e57-466b-8dc4-30db7079b8e0 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received event network-changed-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-feaf7e49-3470-4480-83e8-1da4370ec780 req-8201aeda-5e57-466b-8dc4-30db7079b8e0 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Refreshing instance network info cache due to event network-changed-915517f3-521b-4d3a-a7c0-841b64ac50a8. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-feaf7e49-3470-4480-83e8-1da4370ec780 req-8201aeda-5e57-466b-8dc4-30db7079b8e0 service nova] Acquiring lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-feaf7e49-3470-4480-83e8-1da4370ec780 req-8201aeda-5e57-466b-8dc4-30db7079b8e0 service nova] Acquired lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG nova.network.neutron [req-feaf7e49-3470-4480-83e8-1da4370ec780 req-8201aeda-5e57-466b-8dc4-30db7079b8e0 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Refreshing network info cache for port 915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.network.neutron [req-feaf7e49-3470-4480-83e8-1da4370ec780 req-8201aeda-5e57-466b-8dc4-30db7079b8e0 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updated VIF entry in instance network info cache for port 915517f3-521b-4d3a-a7c0-841b64ac50a8. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.network.neutron [req-feaf7e49-3470-4480-83e8-1da4370ec780 req-8201aeda-5e57-466b-8dc4-30db7079b8e0 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updating instance_info_cache with network_info: [{"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-feaf7e49-3470-4480-83e8-1da4370ec780 req-8201aeda-5e57-466b-8dc4-30db7079b8e0 service nova] Releasing lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:07:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:07:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8281MB free_disk=26.47864532470703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Stashing vm_state: active {{(pid=82184) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:57 user nova-compute[82184]: INFO nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating resource usage from migration 1311b9f9-ad50-423a-b23d-7abceea73319
Apr 12 02:07:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 101410fb-7682-46d8-baf1-18fcebf81cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 1a3c868f-3a4c-430e-8009-7a855e832f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 34a07ab6-379e-48d9-98ae-c32981534331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Migration 1311b9f9-ad50-423a-b23d-7abceea73319 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e4ae774a-0f87-4d51-a997-c8f9b228fe71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:07:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.290s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'pci_requests' on Instance uuid e4ae774a-0f87-4d51-a997-c8f9b228fe71 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:07:58 user nova-compute[82184]: INFO nova.compute.claims [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Claim successful on node user
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'resources' on Instance uuid e4ae774a-0f87-4d51-a997-c8f9b228fe71 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'pci_devices' on Instance uuid e4ae774a-0f87-4d51-a997-c8f9b228fe71 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-d57ff9ed-0bc3-4b70-b46a-ae827f5a5eaf req-dd230fc9-4d1a-4f6c-a221-737cc13bd647 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-changed-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-d57ff9ed-0bc3-4b70-b46a-ae827f5a5eaf req-dd230fc9-4d1a-4f6c-a221-737cc13bd647 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Refreshing instance network info cache due to event network-changed-ce1a5774-7c99-4d64-b16b-2dab8491ff6d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d57ff9ed-0bc3-4b70-b46a-ae827f5a5eaf req-dd230fc9-4d1a-4f6c-a221-737cc13bd647 service nova] Acquiring lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d57ff9ed-0bc3-4b70-b46a-ae827f5a5eaf req-dd230fc9-4d1a-4f6c-a221-737cc13bd647 service nova] Acquired lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.network.neutron [req-d57ff9ed-0bc3-4b70-b46a-ae827f5a5eaf req-dd230fc9-4d1a-4f6c-a221-737cc13bd647 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Refreshing network info cache for port ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:07:58 user nova-compute[82184]: INFO nova.compute.resource_tracker [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating resource usage from migration 1311b9f9-ad50-423a-b23d-7abceea73319
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.350s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:58 user nova-compute[82184]: INFO nova.compute.manager [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Migrating
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.network.neutron [req-d57ff9ed-0bc3-4b70-b46a-ae827f5a5eaf req-dd230fc9-4d1a-4f6c-a221-737cc13bd647 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updated VIF entry in instance network info cache for port ce1a5774-7c99-4d64-b16b-2dab8491ff6d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.network.neutron [req-d57ff9ed-0bc3-4b70-b46a-ae827f5a5eaf req-dd230fc9-4d1a-4f6c-a221-737cc13bd647 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating instance_info_cache with network_info: [{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d57ff9ed-0bc3-4b70-b46a-ae827f5a5eaf req-dd230fc9-4d1a-4f6c-a221-737cc13bd647 service nova] Releasing lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:07:58 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating instance_info_cache with network_info: [{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Starting migrate_disk_and_power_off {{(pid=82184) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-f451f0a8-cb58-45f5-b534-04b18b36fc76 req-aee0b37a-cfe1-438b-9f01-3dcaea1006d8 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-vif-unplugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f451f0a8-cb58-45f5-b534-04b18b36fc76 req-aee0b37a-cfe1-438b-9f01-3dcaea1006d8 service nova] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f451f0a8-cb58-45f5-b534-04b18b36fc76 req-aee0b37a-cfe1-438b-9f01-3dcaea1006d8 service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f451f0a8-cb58-45f5-b534-04b18b36fc76 req-aee0b37a-cfe1-438b-9f01-3dcaea1006d8 service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:07:59 user nova-compute[82184]: DEBUG nova.compute.manager [req-f451f0a8-cb58-45f5-b534-04b18b36fc76 req-aee0b37a-cfe1-438b-9f01-3dcaea1006d8 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] No waiting events found dispatching network-vif-unplugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:07:59 user nova-compute[82184]: WARNING nova.compute.manager [req-f451f0a8-cb58-45f5-b534-04b18b36fc76 req-aee0b37a-cfe1-438b-9f01-3dcaea1006d8 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received unexpected event network-vif-unplugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d for instance with vm_state active and task_state resize_migrating.
Apr 12 02:08:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Instance destroyed successfully.
Apr 12 02:08:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1038265517',display_name='tempest-ServerActionsTestJSON-server-1038265517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1038265517',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-ock7vvu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=e4ae774a-0f87-4d51-a997-c8f9b228fe71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:70:e2:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:70:e2:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_vif [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce1a5774-7c, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:08:00 user nova-compute[82184]: INFO os_vif [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c')
Apr 12 02:08:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXubagWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:08:00 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b4746e-e34d-4321-aa34-3781e53073b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:08:00 user nova-compute[82184]: No targets found.
Apr 12 02:08:00 user nova-compute[82184]: iSNS:
Apr 12 02:08:00 user nova-compute[82184]: No targets found.
Apr 12 02:08:00 user nova-compute[82184]: STATIC:
Apr 12 02:08:00 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194
Apr 12 02:08:00 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:08:00 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:08:00 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98
Apr 12 02:08:00 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:08:00 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:08:00 user nova-compute[82184]: FIRMWARE:
Apr 12 02:08:00 user nova-compute[82184]: No targets found.
Apr 12 02:08:00 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:08:00 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:08:00 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5c61b7-a17b-41c8-a9b2-a3f6fc263704]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b743fd-a065-400f-8997-395839ec33dc]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:00 user nova-compute[82184]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:00 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:00 user nova-compute[82184]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:00 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b7341630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce90c25-780b-4ba8-a14a-4d77dad94a00]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f9d19b-ba28-4fbe-8978-825290d62653]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdbf986-3037-47db-8dd6-4e1ca6bfab2f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1aadf7-91df-4240-b270-6f356ed00b4c]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73ccb93-f1fa-458d-95ed-09860f7f18cd]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cee712-c355-4064-b6c2-34fcc485c47e]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260]
Apr 12 02:08:00 user nova-compute[82184]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260] successful.
Apr 12 02:08:00 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f3fcb8-0f20-468f-bf75-cc1c1a5eec57]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== disconnect_volume: return (327ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:08:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-a4349793-c133-4731-ae7a-40960e6f3deb req-11141171-4e9a-489f-bf8a-53e08b6cb2ac service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received event network-changed-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-a4349793-c133-4731-ae7a-40960e6f3deb req-11141171-4e9a-489f-bf8a-53e08b6cb2ac service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Refreshing instance network info cache due to event network-changed-b7002ebc-047e-4856-bf38-9398ce8b8e6b. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a4349793-c133-4731-ae7a-40960e6f3deb req-11141171-4e9a-489f-bf8a-53e08b6cb2ac service nova] Acquiring lock "refresh_cache-34a07ab6-379e-48d9-98ae-c32981534331" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a4349793-c133-4731-ae7a-40960e6f3deb req-11141171-4e9a-489f-bf8a-53e08b6cb2ac service nova] Acquired lock "refresh_cache-34a07ab6-379e-48d9-98ae-c32981534331" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG nova.network.neutron [req-a4349793-c133-4731-ae7a-40960e6f3deb req-11141171-4e9a-489f-bf8a-53e08b6cb2ac service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Refreshing network info cache for port b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Port ce1a5774-7c99-4d64-b16b-2dab8491ff6d binding to destination host user is already ACTIVE {{(pid=82184) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-cf300519-91ca-4172-b744-1093be180b7c req-a7e9cfc1-82c8-43fc-ad36-f2389904ee87 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cf300519-91ca-4172-b744-1093be180b7c req-a7e9cfc1-82c8-43fc-ad36-f2389904ee87 service nova] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cf300519-91ca-4172-b744-1093be180b7c req-a7e9cfc1-82c8-43fc-ad36-f2389904ee87 service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cf300519-91ca-4172-b744-1093be180b7c req-a7e9cfc1-82c8-43fc-ad36-f2389904ee87 service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-cf300519-91ca-4172-b744-1093be180b7c req-a7e9cfc1-82c8-43fc-ad36-f2389904ee87 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] No waiting events found dispatching network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:08:01 user nova-compute[82184]: WARNING nova.compute.manager [req-cf300519-91ca-4172-b744-1093be180b7c req-a7e9cfc1-82c8-43fc-ad36-f2389904ee87 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received unexpected event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d for instance with vm_state active and task_state resize_migrating.
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-a4349793-c133-4731-ae7a-40960e6f3deb req-11141171-4e9a-489f-bf8a-53e08b6cb2ac service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Updated VIF entry in instance network info cache for port b7002ebc-047e-4856-bf38-9398ce8b8e6b. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-a4349793-c133-4731-ae7a-40960e6f3deb req-11141171-4e9a-489f-bf8a-53e08b6cb2ac service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Updating instance_info_cache with network_info: [{"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a4349793-c133-4731-ae7a-40960e6f3deb req-11141171-4e9a-489f-bf8a-53e08b6cb2ac service nova] Releasing lock "refresh_cache-34a07ab6-379e-48d9-98ae-c32981534331" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG nova.network.neutron [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating instance_info_cache with network_info: [{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG os_brick.utils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16ea41c-9099-4adc-aaef-5f4b8bc69d8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d42555-1487-47a3-802c-a02ad129ee4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a212e47-81e2-4eb5-a78b-8ba7737e631b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c689bb-f5bd-4314-9f90-f686ea11accb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:08:02 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:08:02 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aace4da-3c49-40b3-aef3-129ad12d777d]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG os_brick.utils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'flavor' on Instance uuid 34a07ab6-379e-48d9-98ae-c32981534331 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:03 user nova-compute[82184]: INFO nova.compute.manager [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Attaching volume ee436c5d-23fd-481d-b69f-9563a02987ee to /dev/vdb
Apr 12 02:08:03 user nova-compute[82184]: DEBUG os_brick.utils [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[986e93d7-4abe-41ed-a672-1c7e475edbcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[024e1e51-b280-494f-bffe-58cb00c10006]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4869997a-5ed9-49df-ac5c-7933dd1c7629]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba38fb6-c0eb-4b28-93e8-3a573dba4bf4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:08:03 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:08:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a6dc98-c0e9-4e6c-bbd7-7edb540c067d]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG os_brick.utils [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:08:03 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Updating existing volume attachment record: e76227db-62ae-4d56-af2a-79c99cb081ba {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:08:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:10 user nova-compute[82184]: INFO nova.compute.manager [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attaching volume 33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a to /dev/vdb
Apr 12 02:08:10 user nova-compute[82184]: DEBUG os_brick.utils [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[99197561-9570-44ee-a3c5-8e889604de1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d30e32a-3f99-4dee-997e-016814fb1b98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9bf04f-8b3d-4302-ac9f-3b5de6ba758b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4f38b2-40da-408b-bd5d-d3873f3713e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:08:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:08:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:08:11 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:08:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ceb696-6dd1-4d63-9054-20ff09f9569e]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:08:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:08:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:08:11 user nova-compute[82184]: DEBUG os_brick.utils [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:08:11 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updating existing volume attachment record: 3aee33df-e327-42a0-b891-b155ec8bc206 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:08:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Starting finish_migration {{(pid=82184) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Instance directory exists: not creating {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 02:08:12 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Creating image(s)
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Ensure instance console log exists: /opt/stack/data/nova/instances/e4ae774a-0f87-4d51-a997-c8f9b228fe71/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Start _get_guest_xml network_info=[{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:70:e2:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '5e1d8532-61f4-44e1-9292-04fd40205382', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXubagWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e4ae774a-0f87-4d51-a997-c8f9b228fe71', 'attached_at': '2023-04-12T02:08:12.000000', 'detached_at': '', 'volume_id': '136ed599-e72b-4d77-ad6e-104c14c24194', 'serial': '136ed599-e72b-4d77-ad6e-104c14c24194'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:08:12 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:08:12 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4ae774a-0f87-4d51-a997-c8f9b228fe71 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XPUfoYlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:08:12 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:08:12 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:08:12 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:08:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXubagWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:08:12 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f0fc05-d004-4d7e-bef3-a74bdeab0a01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:08:12 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d82e024-4ef5-4918-bebd-37f3c7914110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee] added
Apr 12 02:08:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a862fcc-d8f4-4f0c-8070-f29a83fa3177]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1ec460-eb82-476e-ba40-6c7d6fe05a30]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XPUfoYlH {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XPUfoYlH" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe3985-6419-4b63-92f1-feecea1aade9]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XPUfoYlH'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad861951-b5f6-4f53-b470-004a5b7f2e23]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e677d7-390e-4c67-ae29-f4625a81687a]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3222dff6-5f84-4a6e-80dd-9080450563cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee, portal: 172.16.0.220,3260]
Apr 12 02:08:12 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee, portal: 172.16.0.220,3260] successful.
Apr 12 02:08:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad14881-8234-46b6-afc0-463fc4f711d8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[280cc427-84a7-4ae0-967b-5215e7cc0a1b]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:12 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:12 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:12 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eedbf6-d0db-4404-831b-9517b85523d3]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:08:12 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XPUfoYlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26462323430346230', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462323430346230', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.282s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:08:13 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:08:13 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'flavor' on Instance uuid 34a07ab6-379e-48d9-98ae-c32981534331 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cf8c93-8bb0-4a99-9865-0e470f3aab05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:08:13 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:08:13 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:08:13 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:08:13 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:08:13 user nova-compute[82184]:   <serial>ee436c5d-23fd-481d-b69f-9563a02987ee</serial>
Apr 12 02:08:13 user nova-compute[82184]: </disk>
Apr 12 02:08:13 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa713f5b-b10d-49bd-b827-1721662b6e12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194] added
Apr 12 02:08:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[843ce1c3-2b2c-496f-984c-5a4a49141b3e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[309fbf08-b988-45e4-8c23-ad901984dbbb]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXubagWC {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rXubagWC" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2695e8-72a2-4974-bf54-639cc66e4913]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rXubagWC'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[84167eb2-4ade-4da5-aa9a-e1a569c52bee]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8de354-c860-43e1-9bbf-e0ed04cc3aba]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:13 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:13 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9929d0ad-a5d7-457b-ac0f-fdcb71cb55db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260]
Apr 12 02:08:13 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260] successful.
Apr 12 02:08:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[239374a9-89a0-4379-b84e-591e54aab9fa]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a874201-e379-460e-90dc-88c894fbe292]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:13 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:13 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:13 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:13 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[206bd5e0-2ed5-4e7a-865a-97fddb816433]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXubagWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:08:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No VIF found with MAC fa:16:3e:b8:c0:ac, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a33b4aa8-f791-42b7-8214-48c86bf61ef5 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.726s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== connect_volume: return (2596ms) {'type': 'block', 'scsi_wwn': '26466653738626261', 'path': '/dev/sdd'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466653738626261', 'path': '/dev/sdd'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1038265517',display_name='tempest-ServerActionsTestJSON-server-1038265517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1038265517',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-ock7vvu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=e4ae774a-0f87-4d51-a997-c8f9b228fe71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:70:e2:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:70:e2:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:08:14 user nova-compute[82184]:   <uuid>e4ae774a-0f87-4d51-a997-c8f9b228fe71</uuid>
Apr 12 02:08:14 user nova-compute[82184]:   <name>instance-0000001e</name>
Apr 12 02:08:14 user nova-compute[82184]:   <memory>196608</memory>
Apr 12 02:08:14 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:08:14 user nova-compute[82184]:   <metadata>
Apr 12 02:08:14 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:08:14 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:08:14 user nova-compute[82184]:       <nova:name>tempest-ServerActionsTestJSON-server-1038265517</nova:name>
Apr 12 02:08:14 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:08:12</nova:creationTime>
Apr 12 02:08:14 user nova-compute[82184]:       <nova:flavor name="m1.micro">
Apr 12 02:08:14 user nova-compute[82184]:         <nova:memory>192</nova:memory>
Apr 12 02:08:14 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:08:14 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:08:14 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:08:14 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:08:14 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:08:14 user nova-compute[82184]:       <nova:owner>
Apr 12 02:08:14 user nova-compute[82184]:         <nova:user uuid="e8e8b9f0307b4d3fb54d89962798026b">tempest-ServerActionsTestJSON-1409832124-project-member</nova:user>
Apr 12 02:08:14 user nova-compute[82184]:         <nova:project uuid="117589cba4a54dd581f4ec5c26b4cd2a">tempest-ServerActionsTestJSON-1409832124</nova:project>
Apr 12 02:08:14 user nova-compute[82184]:       </nova:owner>
Apr 12 02:08:14 user nova-compute[82184]:       <nova:ports>
Apr 12 02:08:14 user nova-compute[82184]:         <nova:port uuid="ce1a5774-7c99-4d64-b16b-2dab8491ff6d">
Apr 12 02:08:14 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 02:08:14 user nova-compute[82184]:         </nova:port>
Apr 12 02:08:14 user nova-compute[82184]:       </nova:ports>
Apr 12 02:08:14 user nova-compute[82184]:     </nova:instance>
Apr 12 02:08:14 user nova-compute[82184]:   </metadata>
Apr 12 02:08:14 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:08:14 user nova-compute[82184]:     <system>
Apr 12 02:08:14 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:08:14 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:08:14 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:08:14 user nova-compute[82184]:       <entry name="serial">e4ae774a-0f87-4d51-a997-c8f9b228fe71</entry>
Apr 12 02:08:14 user nova-compute[82184]:       <entry name="uuid">e4ae774a-0f87-4d51-a997-c8f9b228fe71</entry>
Apr 12 02:08:14 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:08:14 user nova-compute[82184]:     </system>
Apr 12 02:08:14 user nova-compute[82184]:   </sysinfo>
Apr 12 02:08:14 user nova-compute[82184]:   <os>
Apr 12 02:08:14 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:08:14 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:08:14 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:08:14 user nova-compute[82184]:   </os>
Apr 12 02:08:14 user nova-compute[82184]:   <features>
Apr 12 02:08:14 user nova-compute[82184]:     <acpi/>
Apr 12 02:08:14 user nova-compute[82184]:     <apic/>
Apr 12 02:08:14 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:08:14 user nova-compute[82184]:   </features>
Apr 12 02:08:14 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:08:14 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:08:14 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:08:14 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:08:14 user nova-compute[82184]:   </clock>
Apr 12 02:08:14 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:08:14 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:08:14 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:08:14 user nova-compute[82184]:   </cpu>
Apr 12 02:08:14 user nova-compute[82184]:   <devices>
Apr 12 02:08:14 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:08:14 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:08:14 user nova-compute[82184]:       <source dev="/dev/sdd"/>
Apr 12 02:08:14 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:08:14 user nova-compute[82184]:       <serial>136ed599-e72b-4d77-ad6e-104c14c24194</serial>
Apr 12 02:08:14 user nova-compute[82184]:     </disk>
Apr 12 02:08:14 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:08:14 user nova-compute[82184]:       <mac address="fa:16:3e:70:e2:e8"/>
Apr 12 02:08:14 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:08:14 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:08:14 user nova-compute[82184]:       <target dev="tapce1a5774-7c"/>
Apr 12 02:08:14 user nova-compute[82184]:     </interface>
Apr 12 02:08:14 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:08:14 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/e4ae774a-0f87-4d51-a997-c8f9b228fe71/console.log" append="off"/>
Apr 12 02:08:14 user nova-compute[82184]:     </serial>
Apr 12 02:08:14 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:08:14 user nova-compute[82184]:     <video>
Apr 12 02:08:14 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:08:14 user nova-compute[82184]:     </video>
Apr 12 02:08:14 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:08:14 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:08:14 user nova-compute[82184]:     </rng>
Apr 12 02:08:14 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:08:14 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:08:14 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:08:14 user nova-compute[82184]:     </memballoon>
Apr 12 02:08:14 user nova-compute[82184]:   </devices>
Apr 12 02:08:14 user nova-compute[82184]: </domain>
Apr 12 02:08:14 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1038265517',display_name='tempest-ServerActionsTestJSON-server-1038265517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1038265517',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-ock7vvu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=e4ae774a-0f87-4d51-a997-c8f9b228fe71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:70:e2:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-232752764-network", "vif_mac": "fa:16:3e:70:e2:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG os_vif [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce1a5774-7c, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce1a5774-7c, col_values=(('external_ids', {'iface-id': 'ce1a5774-7c99-4d64-b16b-2dab8491ff6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:e2:e8', 'vm-uuid': 'e4ae774a-0f87-4d51-a997-c8f9b228fe71'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:14 user nova-compute[82184]: INFO os_vif [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c')
Apr 12 02:08:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:08:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] No VIF found with MAC fa:16:3e:70:e2:e8, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265280.1052907, e4ae774a-0f87-4d51-a997-c8f9b228fe71 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:08:15 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] VM Stopped (Lifecycle Event)
Apr 12 02:08:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-fa73d0aa-fcb2-4fa9-b027-719397d9438e None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:15 user nova-compute[82184]: INFO nova.compute.manager [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Detaching volume ee436c5d-23fd-481d-b69f-9563a02987ee
Apr 12 02:08:15 user nova-compute[82184]: INFO nova.virt.block_device [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Attempting to driver detach volume ee436c5d-23fd-481d-b69f-9563a02987ee from mountpoint /dev/vdb
Apr 12 02:08:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vneyDgET', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:08:15 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:08:15 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:08:15 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Attempting to detach device vdb from instance 34a07ab6-379e-48d9-98ae-c32981534331 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:08:15 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:08:15 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:08:15 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:08:15 user nova-compute[82184]:   <serial>ee436c5d-23fd-481d-b69f-9563a02987ee</serial>
Apr 12 02:08:15 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:08:15 user nova-compute[82184]: </disk>
Apr 12 02:08:15 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:08:15 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully detached device vdb from instance 34a07ab6-379e-48d9-98ae-c32981534331 from the persistent domain config.
Apr 12 02:08:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34a07ab6-379e-48d9-98ae-c32981534331 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:08:15 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:08:15 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:08:15 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:08:15 user nova-compute[82184]:   <serial>ee436c5d-23fd-481d-b69f-9563a02987ee</serial>
Apr 12 02:08:15 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:08:15 user nova-compute[82184]: </disk>
Apr 12 02:08:15 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5c3a69-0583-4885-81b0-66c0f2c45ffa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:08:15 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[414b0fc3-8dfc-46d2-b9a0-47adb257fb68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a] added
Apr 12 02:08:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9ad1da-0c39-476b-a6ea-5e520a7d83dc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[03602c48-3e09-43d2-93d1-2359183e73ba]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vneyDgET {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vneyDgET" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4390f7-0270-409e-837f-2e91b54a2ed5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vneyDgET'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c7c35f-3f37-4ac8-b548-d936c4f38d86]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d93567-78b0-410b-b500-dfb965618706]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:15 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:15 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:15 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:15 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:15 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:08:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c24faa-195c-4899-a2bc-31d6733af1c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a, portal: 172.16.0.220,3260]
Apr 12 02:08:16 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a, portal: 172.16.0.220,3260] successful.
Apr 12 02:08:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[113cbb47-2061-4d11-b384-04f2dc251b8b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3082bf-68a8-46c5-99f2-234f3255b8db]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:16 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:16 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:16 user nova-compute[82184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a (non-flash)
Apr 12 02:08:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:16 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:16 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:16 user nova-compute[82184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a (non-flash)
Apr 12 02:08:16 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb7c3c9-2a64-4209-905a-f48046e5949f]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vneyDgET', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681265296.3331358, 34a07ab6-379e-48d9-98ae-c32981534331 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34a07ab6-379e-48d9-98ae-c32981534331 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:08:16 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully detached device vdb from instance 34a07ab6-379e-48d9-98ae-c32981534331 from the live domain config.
Apr 12 02:08:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XPUfoYlH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:08:16 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:08:16 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-7d0b6918-11da-4e75-b6e3-77fd178a1434 req-e399c43e-1c62-4a3d-a43f-657ab1a06c33 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7d0b6918-11da-4e75-b6e3-77fd178a1434 req-e399c43e-1c62-4a3d-a43f-657ab1a06c33 service nova] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7d0b6918-11da-4e75-b6e3-77fd178a1434 req-e399c43e-1c62-4a3d-a43f-657ab1a06c33 service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7d0b6918-11da-4e75-b6e3-77fd178a1434 req-e399c43e-1c62-4a3d-a43f-657ab1a06c33 service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-7d0b6918-11da-4e75-b6e3-77fd178a1434 req-e399c43e-1c62-4a3d-a43f-657ab1a06c33 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] No waiting events found dispatching network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:08:16 user nova-compute[82184]: WARNING nova.compute.manager [req-7d0b6918-11da-4e75-b6e3-77fd178a1434 req-e399c43e-1c62-4a3d-a43f-657ab1a06c33 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received unexpected event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d for instance with vm_state active and task_state resize_finish.
Apr 12 02:08:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26266613838663231', 'path': '/dev/sde'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266613838663231', 'path': '/dev/sde'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.742s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG nova.objects.instance [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc18446f-8c5f-4829-84de-b85bfcff0e2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:08:17 user nova-compute[82184]: No targets found.
Apr 12 02:08:17 user nova-compute[82184]: iSNS:
Apr 12 02:08:17 user nova-compute[82184]: No targets found.
Apr 12 02:08:17 user nova-compute[82184]: STATIC:
Apr 12 02:08:17 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194
Apr 12 02:08:17 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:08:17 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:08:17 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee
Apr 12 02:08:17 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:08:17 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:08:17 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a
Apr 12 02:08:17 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:08:17 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:08:17 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98
Apr 12 02:08:17 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:08:17 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:08:17 user nova-compute[82184]: FIRMWARE:
Apr 12 02:08:17 user nova-compute[82184]: No targets found.
Apr 12 02:08:17 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:08:17 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:08:17 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:08:17 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:08:17 user nova-compute[82184]:   <source dev="/dev/sde"/>
Apr 12 02:08:17 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:08:17 user nova-compute[82184]:   <serial>33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a</serial>
Apr 12 02:08:17 user nova-compute[82184]: </disk>
Apr 12 02:08:17 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d290ed19-cc2c-4150-a9c7-61d253aebdf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bada7d25-318f-4336-9e86-066d0311e9d2]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:17 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:17 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:17 user nova-compute[82184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a (non-flash)
Apr 12 02:08:17 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:17 user nova-compute[82184]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee (non-flash)
Apr 12 02:08:17 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:17 user nova-compute[82184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a (non-flash)
Apr 12 02:08:17 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a81e1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0721c60b-816b-41c4-a87a-a98e35b29942]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[71775cfc-21a1-4dcf-a45f-bd9f5ddfd02f]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67fd27f-2905-4b28-b4bb-04af17404e50]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6e6b86-e77c-4c52-82a9-5dcd94da4bb0]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[855a26c0-a43f-4d95-a360-2438e794108b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aeb077d-726e-429d-bcac-c7c5fa6c4bcf]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee, portal: 172.16.0.220,3260]
Apr 12 02:08:17 user nova-compute[82184]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee, portal: 172.16.0.220,3260] successful.
Apr 12 02:08:17 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee436c5d-23fd-481d-b69f-9563a02987ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74a6315-15f5-403b-97ff-b1bb35606244]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] <== disconnect_volume: return (1066ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] No VIF found with MAC fa:16:3e:e2:49:7f, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:08:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-2a71a0ec-90d7-476f-bd83-6ad0293dc53c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.872s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'flavor' on Instance uuid 34a07ab6-379e-48d9-98ae-c32981534331 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a691e44f-7e72-4725-b671-0e5607060523 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.573s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265298.4941852, e4ae774a-0f87-4d51-a997-c8f9b228fe71 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:08:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] VM Resumed (Lifecycle Event)
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:08:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Instance running successfully.
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Failed to set time: agent not configured {{(pid=82184) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-2f761133-141f-44aa-93cc-06ae37434063 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] finish_migration finished successfully. {{(pid=82184) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:08:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265298.496708, e4ae774a-0f87-4d51-a997-c8f9b228fe71 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:08:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] VM Started (Lifecycle Event)
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:08:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1dc46d3-048a-46f8-8aa3-47d0f23b08dc req-d9a7f401-0225-4e56-b523-a1c02e6decbe service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1dc46d3-048a-46f8-8aa3-47d0f23b08dc req-d9a7f401-0225-4e56-b523-a1c02e6decbe service nova] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1dc46d3-048a-46f8-8aa3-47d0f23b08dc req-d9a7f401-0225-4e56-b523-a1c02e6decbe service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a1dc46d3-048a-46f8-8aa3-47d0f23b08dc req-d9a7f401-0225-4e56-b523-a1c02e6decbe service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-a1dc46d3-048a-46f8-8aa3-47d0f23b08dc req-d9a7f401-0225-4e56-b523-a1c02e6decbe service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] No waiting events found dispatching network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:08:18 user nova-compute[82184]: WARNING nova.compute.manager [req-a1dc46d3-048a-46f8-8aa3-47d0f23b08dc req-d9a7f401-0225-4e56-b523-a1c02e6decbe service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received unexpected event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d for instance with vm_state active and task_state resize_finish.
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:19 user nova-compute[82184]: INFO nova.compute.manager [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Detaching volume 33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a
Apr 12 02:08:19 user nova-compute[82184]: INFO nova.virt.block_device [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Attempting to driver detach volume 33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a from mountpoint /dev/vdb
Apr 12 02:08:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Attempting to detach device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:08:19 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:08:19 user nova-compute[82184]:   <source dev="/dev/sde"/>
Apr 12 02:08:19 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:08:19 user nova-compute[82184]:   <serial>33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a</serial>
Apr 12 02:08:19 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:08:19 user nova-compute[82184]: </disk>
Apr 12 02:08:19 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:08:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Successfully detached device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the persistent domain config.
Apr 12 02:08:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:08:19 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:08:19 user nova-compute[82184]:   <source dev="/dev/sde"/>
Apr 12 02:08:19 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:08:19 user nova-compute[82184]:   <serial>33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a</serial>
Apr 12 02:08:19 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:08:19 user nova-compute[82184]: </disk>
Apr 12 02:08:19 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681265299.77882, 101410fb-7682-46d8-baf1-18fcebf81cb8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:08:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Successfully detached device vdb from instance 101410fb-7682-46d8-baf1-18fcebf81cb8 from the live domain config.
Apr 12 02:08:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vneyDgET', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:08:19 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e9177c-1ab6-4cf8-a7bb-7bbb2c49b948]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:08:19 user nova-compute[82184]: No targets found.
Apr 12 02:08:19 user nova-compute[82184]: iSNS:
Apr 12 02:08:19 user nova-compute[82184]: No targets found.
Apr 12 02:08:19 user nova-compute[82184]: STATIC:
Apr 12 02:08:19 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194
Apr 12 02:08:19 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:08:19 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:08:19 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a
Apr 12 02:08:19 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:08:19 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:08:19 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98
Apr 12 02:08:19 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:08:19 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:08:19 user nova-compute[82184]: FIRMWARE:
Apr 12 02:08:19 user nova-compute[82184]: No targets found.
Apr 12 02:08:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:08:19 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:08:19 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ed09ff-9308-41f1-8312-ee0506048a5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2410ac68-26bf-4605-8018-1537b9eb6569]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:19 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:19 user nova-compute[82184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a (non-flash)
Apr 12 02:08:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:08:19 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:08:19 user nova-compute[82184]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a (non-flash)
Apr 12 02:08:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26ac0f5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a'): ({'sde'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Removing single pathed devices sde {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ce42c3-13ff-4789-b0fc-c2e0b773f16c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d76641e-0aae-4128-9ce2-2e7eb02c7f84]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Flushing IO for device /dev/sde {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c29685-92aa-45c6-92ee-b548f8831fad]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cc4cb5-fef2-4a85-9a09-4e79195c8606]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] SCSI volumes sde have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:08:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[275e86ba-1f06-4954-9a8f-2a6bcbfe9c17]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[526bdb26-fb1e-4afb-9f8c-3324d7ae9f51]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a, portal: 172.16.0.220,3260]
Apr 12 02:08:20 user nova-compute[82184]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a, portal: 172.16.0.220,3260] successful.
Apr 12 02:08:20 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33e9c9ea-ca01-4cb4-8946-2e6bd5cdcc7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33501c18-d0f7-4e1e-8f2a-cff58dfdddfc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] <== disconnect_volume: return (330ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:08:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:08:21 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'flavor' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:08:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e30cb6f4-b362-41f7-bde9-fe175e83f9be tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.076s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:08:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:08:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:08:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:08:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:08:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:08:55 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating instance_info_cache with network_info: [{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:08:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:08:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:08:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:08:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:08:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:08:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:55 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:08:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:08:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:08:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8242MB free_disk=26.465469360351562GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Applying migration context for instance e4ae774a-0f87-4d51-a997-c8f9b228fe71 as it has an incoming, in-progress migration 1311b9f9-ad50-423a-b23d-7abceea73319. Migration status is finished {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 02:08:57 user nova-compute[82184]: INFO nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating resource usage from migration 1311b9f9-ad50-423a-b23d-7abceea73319
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 101410fb-7682-46d8-baf1-18fcebf81cb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 1a3c868f-3a4c-430e-8009-7a855e832f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 34a07ab6-379e-48d9-98ae-c32981534331 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Migration 1311b9f9-ad50-423a-b23d-7abceea73319 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e4ae774a-0f87-4d51-a997-c8f9b228fe71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:08:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:08:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:08:59 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:08:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:09:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:09:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:09:04 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:09:04 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:09:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:05 user nova-compute[82184]: INFO nova.compute.manager [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Terminating instance
Apr 12 02:09:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-6b7369f3-97da-49cb-936a-87bf82657fc3 req-58f9377a-9f49-4e4e-aefa-cefcc5a2dc96 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received event network-vif-unplugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6b7369f3-97da-49cb-936a-87bf82657fc3 req-58f9377a-9f49-4e4e-aefa-cefcc5a2dc96 service nova] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6b7369f3-97da-49cb-936a-87bf82657fc3 req-58f9377a-9f49-4e4e-aefa-cefcc5a2dc96 service nova] Lock "34a07ab6-379e-48d9-98ae-c32981534331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6b7369f3-97da-49cb-936a-87bf82657fc3 req-58f9377a-9f49-4e4e-aefa-cefcc5a2dc96 service nova] Lock "34a07ab6-379e-48d9-98ae-c32981534331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-6b7369f3-97da-49cb-936a-87bf82657fc3 req-58f9377a-9f49-4e4e-aefa-cefcc5a2dc96 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] No waiting events found dispatching network-vif-unplugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG nova.compute.manager [req-6b7369f3-97da-49cb-936a-87bf82657fc3 req-58f9377a-9f49-4e4e-aefa-cefcc5a2dc96 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received event network-vif-unplugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:06 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Instance destroyed successfully.
Apr 12 02:09:06 user nova-compute[82184]: DEBUG nova.objects.instance [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'resources' on Instance uuid 34a07ab6-379e-48d9-98ae-c32981534331 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:06:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-480594431',display_name='tempest-AttachVolumeNegativeTest-server-480594431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-480594431',id=31,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcsML6e7K9uGCYUP4kt9wqcviwiqIOeLK8iydSZvfdudxeVEzsOqCjAyVKD2yM1mhoVoiEzSVXVeJk4zlr5bUmtwCS+FsbuW8X8MAkaRSN0nt1uVNJsz9hu0laZovkkCA==',key_name='tempest-keypair-697615423',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:06:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-yppa6hyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=34a07ab6-379e-48d9-98ae-c32981534331,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "address": "fa:16:3e:b8:c0:ac", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7002ebc-04", "ovs_interfaceid": "b7002ebc-047e-4856-bf38-9398ce8b8e6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:c0:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7002ebc-047e-4856-bf38-9398ce8b8e6b,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7002ebc-04') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG os_vif [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:c0:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7002ebc-047e-4856-bf38-9398ce8b8e6b,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7002ebc-04') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7002ebc-04, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:09:06 user nova-compute[82184]: INFO os_vif [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:c0:ac,bridge_name='br-int',has_traffic_filtering=True,id=b7002ebc-047e-4856-bf38-9398ce8b8e6b,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7002ebc-04')
Apr 12 02:09:06 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Deleting instance files /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331_del
Apr 12 02:09:06 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Deletion of /opt/stack/data/nova/instances/34a07ab6-379e-48d9-98ae-c32981534331_del complete
Apr 12 02:09:06 user nova-compute[82184]: INFO nova.compute.manager [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 02:09:06 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:09:06 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:09:07 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:09:07 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Took 0.71 seconds to deallocate network for instance.
Apr 12 02:09:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-f0c4a150-7e1f-4da2-a6dc-b23d651790d0 req-af1b03d8-395c-4797-b243-1864317a4877 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received event network-vif-deleted-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:09:07 user nova-compute[82184]: INFO nova.compute.manager [req-f0c4a150-7e1f-4da2-a6dc-b23d651790d0 req-af1b03d8-395c-4797-b243-1864317a4877 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Neutron deleted interface b7002ebc-047e-4856-bf38-9398ce8b8e6b; detaching it from the instance and deleting it from the info cache
Apr 12 02:09:07 user nova-compute[82184]: DEBUG nova.network.neutron [req-f0c4a150-7e1f-4da2-a6dc-b23d651790d0 req-af1b03d8-395c-4797-b243-1864317a4877 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:09:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-f0c4a150-7e1f-4da2-a6dc-b23d651790d0 req-af1b03d8-395c-4797-b243-1864317a4877 service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Detach interface failed, port_id=b7002ebc-047e-4856-bf38-9398ce8b8e6b, reason: Instance 34a07ab6-379e-48d9-98ae-c32981534331 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 02:09:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:07 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:09:07 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:09:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:07 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Deleted allocations for instance 34a07ab6-379e-48d9-98ae-c32981534331
Apr 12 02:09:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0a525f07-5445-4d0a-a91f-5c4a796d99d6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "34a07ab6-379e-48d9-98ae-c32981534331" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.986s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-6229bd3d-7729-4f04-8b6f-97343239afce req-9a56edd4-5d36-4819-9714-b206afe6cbdd service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received event network-vif-plugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:09:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6229bd3d-7729-4f04-8b6f-97343239afce req-9a56edd4-5d36-4819-9714-b206afe6cbdd service nova] Acquiring lock "34a07ab6-379e-48d9-98ae-c32981534331-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6229bd3d-7729-4f04-8b6f-97343239afce req-9a56edd4-5d36-4819-9714-b206afe6cbdd service nova] Lock "34a07ab6-379e-48d9-98ae-c32981534331-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6229bd3d-7729-4f04-8b6f-97343239afce req-9a56edd4-5d36-4819-9714-b206afe6cbdd service nova] Lock "34a07ab6-379e-48d9-98ae-c32981534331-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-6229bd3d-7729-4f04-8b6f-97343239afce req-9a56edd4-5d36-4819-9714-b206afe6cbdd service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] No waiting events found dispatching network-vif-plugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:09:08 user nova-compute[82184]: WARNING nova.compute.manager [req-6229bd3d-7729-4f04-8b6f-97343239afce req-9a56edd4-5d36-4819-9714-b206afe6cbdd service nova] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Received unexpected event network-vif-plugged-b7002ebc-047e-4856-bf38-9398ce8b8e6b for instance with vm_state deleted and task_state None.
Apr 12 02:09:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:09:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-7c6830e6-9471-49d5-842f-abd9c5dd94c5 req-2134622c-dbc7-4a4a-9e05-081683dc0f2b service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received event network-changed-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:09:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-7c6830e6-9471-49d5-842f-abd9c5dd94c5 req-2134622c-dbc7-4a4a-9e05-081683dc0f2b service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Refreshing instance network info cache due to event network-changed-280a0eb1-7bff-42d2-a75e-69eba211ffbb. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:09:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7c6830e6-9471-49d5-842f-abd9c5dd94c5 req-2134622c-dbc7-4a4a-9e05-081683dc0f2b service nova] Acquiring lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:09:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7c6830e6-9471-49d5-842f-abd9c5dd94c5 req-2134622c-dbc7-4a4a-9e05-081683dc0f2b service nova] Acquired lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:09:19 user nova-compute[82184]: DEBUG nova.network.neutron [req-7c6830e6-9471-49d5-842f-abd9c5dd94c5 req-2134622c-dbc7-4a4a-9e05-081683dc0f2b service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Refreshing network info cache for port 280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:09:19 user nova-compute[82184]: DEBUG nova.network.neutron [req-7c6830e6-9471-49d5-842f-abd9c5dd94c5 req-2134622c-dbc7-4a4a-9e05-081683dc0f2b service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updated VIF entry in instance network info cache for port 280a0eb1-7bff-42d2-a75e-69eba211ffbb. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:09:19 user nova-compute[82184]: DEBUG nova.network.neutron [req-7c6830e6-9471-49d5-842f-abd9c5dd94c5 req-2134622c-dbc7-4a4a-9e05-081683dc0f2b service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updating instance_info_cache with network_info: [{"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:09:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7c6830e6-9471-49d5-842f-abd9c5dd94c5 req-2134622c-dbc7-4a4a-9e05-081683dc0f2b service nova] Releasing lock "refresh_cache-101410fb-7682-46d8-baf1-18fcebf81cb8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:21 user nova-compute[82184]: INFO nova.compute.manager [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Terminating instance
Apr 12 02:09:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-6d15c67c-3c78-42ce-8bdd-9337b09e4506 req-7a4dc4b9-03a1-4a03-9cc7-4f81affeb49e service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received event network-vif-unplugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6d15c67c-3c78-42ce-8bdd-9337b09e4506 req-7a4dc4b9-03a1-4a03-9cc7-4f81affeb49e service nova] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6d15c67c-3c78-42ce-8bdd-9337b09e4506 req-7a4dc4b9-03a1-4a03-9cc7-4f81affeb49e service nova] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6d15c67c-3c78-42ce-8bdd-9337b09e4506 req-7a4dc4b9-03a1-4a03-9cc7-4f81affeb49e service nova] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-6d15c67c-3c78-42ce-8bdd-9337b09e4506 req-7a4dc4b9-03a1-4a03-9cc7-4f81affeb49e service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] No waiting events found dispatching network-vif-unplugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-6d15c67c-3c78-42ce-8bdd-9337b09e4506 req-7a4dc4b9-03a1-4a03-9cc7-4f81affeb49e service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received event network-vif-unplugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265346.732667, 34a07ab6-379e-48d9-98ae-c32981534331 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:09:21 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] VM Stopped (Lifecycle Event)
Apr 12 02:09:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-233ab0ae-4a4b-496a-b18c-1569ded9af38 None None] [instance: 34a07ab6-379e-48d9-98ae-c32981534331] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:09:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:22 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Instance destroyed successfully.
Apr 12 02:09:22 user nova-compute[82184]: DEBUG nova.objects.instance [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lazy-loading 'resources' on Instance uuid 101410fb-7682-46d8-baf1-18fcebf81cb8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:03:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1689225161',display_name='tempest-SnapshotDataIntegrityTests-server-1689225161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1689225161',id=27,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBzPcQjTv2Jael0y5wrvN4uSHK22wC+4MQYihJ4lkSsarIJtgTRNzEUL9q5zwomDyXY8RX+h7kFLUBsKlQRa2wYp3AwqYZTBzQkYcWYnC7AOOfvjs6Z8ppYHAJYpNSM3yg==',key_name='tempest-SnapshotDataIntegrityTests-522022221',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='910948b97a01432fb70094eb6ec30379',ramdisk_id='',reservation_id='r-hklkmddv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1739495878',owner_user_name='tempest-SnapshotDataIntegrityTests-1739495878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:03:15Z,user_data=None,user_id='34ca83258ae04dee81b8552a6c7e3c2f',uuid=101410fb-7682-46d8-baf1-18fcebf81cb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Converting VIF {"id": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "address": "fa:16:3e:e2:49:7f", "network": {"id": "6f35d61b-46c4-4830-984f-93b7bfa8836c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1151452917-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "910948b97a01432fb70094eb6ec30379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap280a0eb1-7b", "ovs_interfaceid": "280a0eb1-7bff-42d2-a75e-69eba211ffbb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=280a0eb1-7bff-42d2-a75e-69eba211ffbb,network=Network(6f35d61b-46c4-4830-984f-93b7bfa8836c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280a0eb1-7b') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG os_vif [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=280a0eb1-7bff-42d2-a75e-69eba211ffbb,network=Network(6f35d61b-46c4-4830-984f-93b7bfa8836c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280a0eb1-7b') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap280a0eb1-7b, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:09:22 user nova-compute[82184]: INFO os_vif [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:49:7f,bridge_name='br-int',has_traffic_filtering=True,id=280a0eb1-7bff-42d2-a75e-69eba211ffbb,network=Network(6f35d61b-46c4-4830-984f-93b7bfa8836c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap280a0eb1-7b')
Apr 12 02:09:22 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Deleting instance files /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8_del
Apr 12 02:09:22 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Deletion of /opt/stack/data/nova/instances/101410fb-7682-46d8-baf1-18fcebf81cb8_del complete
Apr 12 02:09:22 user nova-compute[82184]: INFO nova.compute.manager [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 12 02:09:22 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:09:22 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Took 0.46 seconds to deallocate network for instance.
Apr 12 02:09:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:09:22 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:09:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:23 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Deleted allocations for instance 101410fb-7682-46d8-baf1-18fcebf81cb8
Apr 12 02:09:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-927c3da7-fb6f-4f83-baea-9f79984dd84c tempest-SnapshotDataIntegrityTests-1739495878 tempest-SnapshotDataIntegrityTests-1739495878-project-member] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.658s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-b45f06b1-db22-4679-87ea-22221b7821f0 req-8002d912-c6d3-47a1-834d-297e2106424c service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received event network-vif-plugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:09:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b45f06b1-db22-4679-87ea-22221b7821f0 req-8002d912-c6d3-47a1-834d-297e2106424c service nova] Acquiring lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b45f06b1-db22-4679-87ea-22221b7821f0 req-8002d912-c6d3-47a1-834d-297e2106424c service nova] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b45f06b1-db22-4679-87ea-22221b7821f0 req-8002d912-c6d3-47a1-834d-297e2106424c service nova] Lock "101410fb-7682-46d8-baf1-18fcebf81cb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-b45f06b1-db22-4679-87ea-22221b7821f0 req-8002d912-c6d3-47a1-834d-297e2106424c service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] No waiting events found dispatching network-vif-plugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:09:23 user nova-compute[82184]: WARNING nova.compute.manager [req-b45f06b1-db22-4679-87ea-22221b7821f0 req-8002d912-c6d3-47a1-834d-297e2106424c service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received unexpected event network-vif-plugged-280a0eb1-7bff-42d2-a75e-69eba211ffbb for instance with vm_state deleted and task_state None.
Apr 12 02:09:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-b45f06b1-db22-4679-87ea-22221b7821f0 req-8002d912-c6d3-47a1-834d-297e2106424c service nova] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Received event network-vif-deleted-280a0eb1-7bff-42d2-a75e-69eba211ffbb {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:09:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "2f23b57e-3bf8-442a-8072-2ae145f9104a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:09:29 user nova-compute[82184]: INFO nova.compute.claims [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Claim successful on node user
Apr 12 02:09:29 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:09:29 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:09:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:09:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:09:29 user nova-compute[82184]: INFO nova.virt.block_device [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Booting with volume snapshot d6c1c4cc-af38-437e-a229-fef7a5bfeebf at /dev/vda
Apr 12 02:09:29 user nova-compute[82184]: DEBUG nova.policy [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d5d81fffb14b1cab84b6160ceb7dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd685278576490480a97cd2bc5e048b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:09:30 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Successfully created port: 1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Successfully updated port: 1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "refresh_cache-2f23b57e-3bf8-442a-8072-2ae145f9104a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquired lock "refresh_cache-2f23b57e-3bf8-442a-8072-2ae145f9104a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-33057fd6-77f2-49d0-85d4-c4143666ad5a req-5a107e9f-b8ca-451d-9562-2a13551f67d0 service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Received event network-changed-1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-33057fd6-77f2-49d0-85d4-c4143666ad5a req-5a107e9f-b8ca-451d-9562-2a13551f67d0 service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Refreshing instance network info cache due to event network-changed-1535b023-7f14-4e27-9691-f6728b943cfe. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-33057fd6-77f2-49d0-85d4-c4143666ad5a req-5a107e9f-b8ca-451d-9562-2a13551f67d0 service nova] Acquiring lock "refresh_cache-2f23b57e-3bf8-442a-8072-2ae145f9104a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Updating instance_info_cache with network_info: [{"id": "1535b023-7f14-4e27-9691-f6728b943cfe", "address": "fa:16:3e:23:90:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1535b023-7f", "ovs_interfaceid": "1535b023-7f14-4e27-9691-f6728b943cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Releasing lock "refresh_cache-2f23b57e-3bf8-442a-8072-2ae145f9104a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Instance network_info: |[{"id": "1535b023-7f14-4e27-9691-f6728b943cfe", "address": "fa:16:3e:23:90:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1535b023-7f", "ovs_interfaceid": "1535b023-7f14-4e27-9691-f6728b943cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-33057fd6-77f2-49d0-85d4-c4143666ad5a req-5a107e9f-b8ca-451d-9562-2a13551f67d0 service nova] Acquired lock "refresh_cache-2f23b57e-3bf8-442a-8072-2ae145f9104a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG nova.network.neutron [req-33057fd6-77f2-49d0-85d4-c4143666ad5a req-5a107e9f-b8ca-451d-9562-2a13551f67d0 service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Refreshing network info cache for port 1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:09:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:32 user nova-compute[82184]: DEBUG nova.network.neutron [req-33057fd6-77f2-49d0-85d4-c4143666ad5a req-5a107e9f-b8ca-451d-9562-2a13551f67d0 service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Updated VIF entry in instance network info cache for port 1535b023-7f14-4e27-9691-f6728b943cfe. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:09:32 user nova-compute[82184]: DEBUG nova.network.neutron [req-33057fd6-77f2-49d0-85d4-c4143666ad5a req-5a107e9f-b8ca-451d-9562-2a13551f67d0 service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Updating instance_info_cache with network_info: [{"id": "1535b023-7f14-4e27-9691-f6728b943cfe", "address": "fa:16:3e:23:90:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1535b023-7f", "ovs_interfaceid": "1535b023-7f14-4e27-9691-f6728b943cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:09:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-33057fd6-77f2-49d0-85d4-c4143666ad5a req-5a107e9f-b8ca-451d-9562-2a13551f67d0 service nova] Releasing lock "refresh_cache-2f23b57e-3bf8-442a-8072-2ae145f9104a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG os_brick.utils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc82046-cb38-448e-814b-a628826fa03a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dbcdc6-a83b-4e4b-ba3b-752b038cee37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8263db60-4883-4dfc-b4c1-9c84e1b0b3e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca5f95d-ada2-4701-b720-a21f778ee665]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:09:35 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:09:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00125af-ca61-476d-8f56-a1299309b62b]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG os_brick.utils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:09:35 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Updating existing volume attachment record: 186a2d4c-9e2c-4580-89c6-1ffa18d55421 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:09:37 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265362.2273333, 101410fb-7682-46d8-baf1-18fcebf81cb8 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:09:37 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] VM Stopped (Lifecycle Event)
Apr 12 02:09:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-ce91359d-257f-4295-9d4f-0f12cbc8c281 None None] [instance: 101410fb-7682-46d8-baf1-18fcebf81cb8] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:09:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:09:40 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Creating image(s)
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Ensure instance console log exists: /opt/stack/data/nova/instances/2f23b57e-3bf8-442a-8072-2ae145f9104a/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Start _get_guest_xml network_info=[{"id": "1535b023-7f14-4e27-9691-f6728b943cfe", "address": "fa:16:3e:23:90:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1535b023-7f", "ovs_interfaceid": "1535b023-7f14-4e27-9691-f6728b943cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T02:09:27Z,direct_url=<?>,disk_format='qcow2',id=594e2609-87fd-4742-9919-8292fb3c9aa4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-102112020',owner='bcd685278576490480a97cd2bc5e048b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T02:09:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '186a2d4c-9e2c-4580-89c6-1ffa18d55421', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMEWbHYe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f23b57e-3bf8-442a-8072-2ae145f9104a', 'attached_at': '', 'detached_at': '', 'volume_id': '0fda3311-9867-4a4c-aba5-cb351634580b', 'serial': '0fda3311-9867-4a4c-aba5-cb351634580b'}, 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:09:40 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:09:40 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T02:09:27Z,direct_url=<?>,disk_format='qcow2',id=594e2609-87fd-4742-9919-8292fb3c9aa4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-102112020',owner='bcd685278576490480a97cd2bc5e048b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T02:09:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMEWbHYe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:09:40 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:09:40 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:09:40 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa4fd0d-96b8-45bc-9196-8f5b90339226]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:09:40 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3005656-da5f-4907-8030-72d3026b4441]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b] added
Apr 12 02:09:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[152c39dc-6cc9-4a26-878d-2461e1f82217]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[00beefd7-858d-4918-b2e3-a1026a3bb550]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMEWbHYe {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uMEWbHYe" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84b7077-ac5b-42e0-ac53-24cb1cb87691]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uMEWbHYe'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.059s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7324ee64-b5d3-402b-a948-30035f57a156]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb7cef1-5db1-40c9-86f1-f6560dff6763]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:09:40 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:09:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:09:40 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:09:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[240baf3f-b286-416a-9271-892fb4b4b8ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b, portal: 172.16.0.220,3260]
Apr 12 02:09:40 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b, portal: 172.16.0.220,3260] successful.
Apr 12 02:09:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea54755-6e41-4039-949a-05d75c3fe846]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c9b44b-bc25-4b65-b2b6-c8d043047deb]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:09:40 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:09:40 user nova-compute[82184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b (non-flash)
Apr 12 02:09:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:09:40 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:09:40 user nova-compute[82184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b (non-flash)
Apr 12 02:09:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef0dd03-4a19-48c4-bd10-9f0a7ea062a7]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:09:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMEWbHYe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23837343863313638', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837343863313638', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2306241',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2306241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2306241',id=33,image_ref='594e2609-87fd-4742-9919-8292fb3c9aa4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-0cobontw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2043953815',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:09:30Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=2f23b57e-3bf8-442a-8072-2ae145f9104a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1535b023-7f14-4e27-9691-f6728b943cfe", "address": "fa:16:3e:23:90:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1535b023-7f", "ovs_interfaceid": "1535b023-7f14-4e27-9691-f6728b943cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "1535b023-7f14-4e27-9691-f6728b943cfe", "address": "fa:16:3e:23:90:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1535b023-7f", "ovs_interfaceid": "1535b023-7f14-4e27-9691-f6728b943cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:90:d5,bridge_name='br-int',has_traffic_filtering=True,id=1535b023-7f14-4e27-9691-f6728b943cfe,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1535b023-7f') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f23b57e-3bf8-442a-8072-2ae145f9104a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:09:41 user nova-compute[82184]:   <uuid>2f23b57e-3bf8-442a-8072-2ae145f9104a</uuid>
Apr 12 02:09:41 user nova-compute[82184]:   <name>instance-00000021</name>
Apr 12 02:09:41 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:09:41 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:09:41 user nova-compute[82184]:   <metadata>
Apr 12 02:09:41 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:09:41 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:09:41 user nova-compute[82184]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2306241</nova:name>
Apr 12 02:09:41 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:09:40</nova:creationTime>
Apr 12 02:09:41 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:09:41 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:09:41 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:09:41 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:09:41 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:09:41 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:09:41 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:09:41 user nova-compute[82184]:       <nova:owner>
Apr 12 02:09:41 user nova-compute[82184]:         <nova:user uuid="69d5d81fffb14b1cab84b6160ceb7dd2">tempest-TestVolumeBootPattern-2043953815-project-member</nova:user>
Apr 12 02:09:41 user nova-compute[82184]:         <nova:project uuid="bcd685278576490480a97cd2bc5e048b">tempest-TestVolumeBootPattern-2043953815</nova:project>
Apr 12 02:09:41 user nova-compute[82184]:       </nova:owner>
Apr 12 02:09:41 user nova-compute[82184]:       <nova:root type="image" uuid="594e2609-87fd-4742-9919-8292fb3c9aa4"/>
Apr 12 02:09:41 user nova-compute[82184]:       <nova:ports>
Apr 12 02:09:41 user nova-compute[82184]:         <nova:port uuid="1535b023-7f14-4e27-9691-f6728b943cfe">
Apr 12 02:09:41 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 02:09:41 user nova-compute[82184]:         </nova:port>
Apr 12 02:09:41 user nova-compute[82184]:       </nova:ports>
Apr 12 02:09:41 user nova-compute[82184]:     </nova:instance>
Apr 12 02:09:41 user nova-compute[82184]:   </metadata>
Apr 12 02:09:41 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:09:41 user nova-compute[82184]:     <system>
Apr 12 02:09:41 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:09:41 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:09:41 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:09:41 user nova-compute[82184]:       <entry name="serial">2f23b57e-3bf8-442a-8072-2ae145f9104a</entry>
Apr 12 02:09:41 user nova-compute[82184]:       <entry name="uuid">2f23b57e-3bf8-442a-8072-2ae145f9104a</entry>
Apr 12 02:09:41 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:09:41 user nova-compute[82184]:     </system>
Apr 12 02:09:41 user nova-compute[82184]:   </sysinfo>
Apr 12 02:09:41 user nova-compute[82184]:   <os>
Apr 12 02:09:41 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:09:41 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:09:41 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:09:41 user nova-compute[82184]:   </os>
Apr 12 02:09:41 user nova-compute[82184]:   <features>
Apr 12 02:09:41 user nova-compute[82184]:     <acpi/>
Apr 12 02:09:41 user nova-compute[82184]:     <apic/>
Apr 12 02:09:41 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:09:41 user nova-compute[82184]:   </features>
Apr 12 02:09:41 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:09:41 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:09:41 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:09:41 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:09:41 user nova-compute[82184]:   </clock>
Apr 12 02:09:41 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:09:41 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:09:41 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:09:41 user nova-compute[82184]:   </cpu>
Apr 12 02:09:41 user nova-compute[82184]:   <devices>
Apr 12 02:09:41 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:09:41 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:09:41 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 02:09:41 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:09:41 user nova-compute[82184]:       <serial>0fda3311-9867-4a4c-aba5-cb351634580b</serial>
Apr 12 02:09:41 user nova-compute[82184]:     </disk>
Apr 12 02:09:41 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:09:41 user nova-compute[82184]:       <mac address="fa:16:3e:23:90:d5"/>
Apr 12 02:09:41 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:09:41 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:09:41 user nova-compute[82184]:       <target dev="tap1535b023-7f"/>
Apr 12 02:09:41 user nova-compute[82184]:     </interface>
Apr 12 02:09:41 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:09:41 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/2f23b57e-3bf8-442a-8072-2ae145f9104a/console.log" append="off"/>
Apr 12 02:09:41 user nova-compute[82184]:     </serial>
Apr 12 02:09:41 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:09:41 user nova-compute[82184]:     <video>
Apr 12 02:09:41 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:09:41 user nova-compute[82184]:     </video>
Apr 12 02:09:41 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:09:41 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:09:41 user nova-compute[82184]:     </rng>
Apr 12 02:09:41 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:09:41 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:09:41 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:09:41 user nova-compute[82184]:     </memballoon>
Apr 12 02:09:41 user nova-compute[82184]:   </devices>
Apr 12 02:09:41 user nova-compute[82184]: </domain>
Apr 12 02:09:41 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2306241',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2306241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2306241',id=33,image_ref='594e2609-87fd-4742-9919-8292fb3c9aa4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-0cobontw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2043953815',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:09:30Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=2f23b57e-3bf8-442a-8072-2ae145f9104a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1535b023-7f14-4e27-9691-f6728b943cfe", "address": "fa:16:3e:23:90:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1535b023-7f", "ovs_interfaceid": "1535b023-7f14-4e27-9691-f6728b943cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "1535b023-7f14-4e27-9691-f6728b943cfe", "address": "fa:16:3e:23:90:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1535b023-7f", "ovs_interfaceid": "1535b023-7f14-4e27-9691-f6728b943cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:90:d5,bridge_name='br-int',has_traffic_filtering=True,id=1535b023-7f14-4e27-9691-f6728b943cfe,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1535b023-7f') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG os_vif [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:90:d5,bridge_name='br-int',has_traffic_filtering=True,id=1535b023-7f14-4e27-9691-f6728b943cfe,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1535b023-7f') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1535b023-7f, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1535b023-7f, col_values=(('external_ids', {'iface-id': '1535b023-7f14-4e27-9691-f6728b943cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:90:d5', 'vm-uuid': '2f23b57e-3bf8-442a-8072-2ae145f9104a'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:09:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:41 user nova-compute[82184]: INFO os_vif [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:90:d5,bridge_name='br-int',has_traffic_filtering=True,id=1535b023-7f14-4e27-9691-f6728b943cfe,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1535b023-7f')
Apr 12 02:09:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:09:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No VIF found with MAC fa:16:3e:23:90:d5, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:09:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-6e7e2589-2f98-4a4b-899b-7787612b9fba req-9f3ea644-4f09-4012-b12c-ce2acdb8eabd service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Received event network-vif-plugged-1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:09:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6e7e2589-2f98-4a4b-899b-7787612b9fba req-9f3ea644-4f09-4012-b12c-ce2acdb8eabd service nova] Acquiring lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6e7e2589-2f98-4a4b-899b-7787612b9fba req-9f3ea644-4f09-4012-b12c-ce2acdb8eabd service nova] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6e7e2589-2f98-4a4b-899b-7787612b9fba req-9f3ea644-4f09-4012-b12c-ce2acdb8eabd service nova] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-6e7e2589-2f98-4a4b-899b-7787612b9fba req-9f3ea644-4f09-4012-b12c-ce2acdb8eabd service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] No waiting events found dispatching network-vif-plugged-1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:09:43 user nova-compute[82184]: WARNING nova.compute.manager [req-6e7e2589-2f98-4a4b-899b-7787612b9fba req-9f3ea644-4f09-4012-b12c-ce2acdb8eabd service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Received unexpected event network-vif-plugged-1535b023-7f14-4e27-9691-f6728b943cfe for instance with vm_state building and task_state spawning.
Apr 12 02:09:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265385.3200629, 2f23b57e-3bf8-442a-8072-2ae145f9104a => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:09:45 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] VM Resumed (Lifecycle Event)
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:09:45 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Instance spawned successfully.
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:09:45 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265385.3202908, 2f23b57e-3bf8-442a-8072-2ae145f9104a => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:09:45 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] VM Started (Lifecycle Event)
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:09:45 user nova-compute[82184]: INFO nova.compute.manager [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Took 4.98 seconds to spawn the instance on the hypervisor.
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:09:45 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.compute.manager [req-8ba2a752-51dd-49c9-a403-89510813d2ae req-49101597-c343-472e-8c3f-3ed0d34b493b service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Received event network-vif-plugged-1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8ba2a752-51dd-49c9-a403-89510813d2ae req-49101597-c343-472e-8c3f-3ed0d34b493b service nova] Acquiring lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8ba2a752-51dd-49c9-a403-89510813d2ae req-49101597-c343-472e-8c3f-3ed0d34b493b service nova] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8ba2a752-51dd-49c9-a403-89510813d2ae req-49101597-c343-472e-8c3f-3ed0d34b493b service nova] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:45 user nova-compute[82184]: DEBUG nova.compute.manager [req-8ba2a752-51dd-49c9-a403-89510813d2ae req-49101597-c343-472e-8c3f-3ed0d34b493b service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] No waiting events found dispatching network-vif-plugged-1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:09:45 user nova-compute[82184]: WARNING nova.compute.manager [req-8ba2a752-51dd-49c9-a403-89510813d2ae req-49101597-c343-472e-8c3f-3ed0d34b493b service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Received unexpected event network-vif-plugged-1535b023-7f14-4e27-9691-f6728b943cfe for instance with vm_state building and task_state spawning.
Apr 12 02:09:45 user nova-compute[82184]: INFO nova.compute.manager [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Took 16.00 seconds to build instance.
Apr 12 02:09:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b612baab-26a6-410a-86d3-aad5ec829514 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.088s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Going to confirm migration 2 {{(pid=82184) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquired lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG nova.network.neutron [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG nova.objects.instance [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'info_cache' on Instance uuid e4ae774a-0f87-4d51-a997-c8f9b228fe71 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG nova.network.neutron [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating instance_info_cache with network_info: [{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Releasing lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG nova.objects.instance [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'migration_context' on Instance uuid e4ae774a-0f87-4d51-a997-c8f9b228fe71 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:48 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:09:48 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:09:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.241s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:48 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Deleted allocation for migration 1311b9f9-ad50-423a-b23d-7abceea73319
Apr 12 02:09:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-228a0cb7-4752-4207-9fb9-8b2528d4f78d tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.147s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:09:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:09:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:09:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:09:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:09:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:09:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:55 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:09:55 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:09:55 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:09:55 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:09:56 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:09:56 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8353MB free_disk=26.502147674560547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 1a3c868f-3a4c-430e-8009-7a855e832f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e4ae774a-0f87-4d51-a997-c8f9b228fe71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2f23b57e-3bf8-442a-8072-2ae145f9104a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:09:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:09:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:09:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:09:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:09:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:09:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:09:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:09:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:59 user nova-compute[82184]: DEBUG nova.compute.manager [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:09:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:09:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:09:59 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:09:59 user nova-compute[82184]: INFO nova.compute.claims [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Claim successful on node user
Apr 12 02:10:00 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG nova.network.neutron [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:10:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:10:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG nova.policy [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '189b7aba48014bedacfa021cc3cad5e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2acf278c981e481fbe43e415c76aa6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:10:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Creating image(s)
Apr 12 02:10:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "/opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "/opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "/opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.405s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:10:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk 1073741824" returned: 0 in 0.056s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Successfully created port: 50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Cannot resize image /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.objects.instance [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'migration_context' on Instance uuid afccc0c5-9184-4a0c-a11e-50618b6e528d {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Ensure instance console log exists: /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Successfully updated port: 50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "refresh_cache-afccc0c5-9184-4a0c-a11e-50618b6e528d" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquired lock "refresh_cache-afccc0c5-9184-4a0c-a11e-50618b6e528d" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-8d8e4acc-bb23-4222-aaae-d0e40c47c985 req-0df5c3df-0de6-435b-8f5b-deb1670f0173 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received event network-changed-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-8d8e4acc-bb23-4222-aaae-d0e40c47c985 req-0df5c3df-0de6-435b-8f5b-deb1670f0173 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Refreshing instance network info cache due to event network-changed-50c67357-42ce-4826-b568-696829fac338. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8d8e4acc-bb23-4222-aaae-d0e40c47c985 req-0df5c3df-0de6-435b-8f5b-deb1670f0173 service nova] Acquiring lock "refresh_cache-afccc0c5-9184-4a0c-a11e-50618b6e528d" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:10:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.network.neutron [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Updating instance_info_cache with network_info: [{"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Releasing lock "refresh_cache-afccc0c5-9184-4a0c-a11e-50618b6e528d" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Instance network_info: |[{"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8d8e4acc-bb23-4222-aaae-d0e40c47c985 req-0df5c3df-0de6-435b-8f5b-deb1670f0173 service nova] Acquired lock "refresh_cache-afccc0c5-9184-4a0c-a11e-50618b6e528d" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-8d8e4acc-bb23-4222-aaae-d0e40c47c985 req-0df5c3df-0de6-435b-8f5b-deb1670f0173 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Refreshing network info cache for port 50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Start _get_guest_xml network_info=[{"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:10:02 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:10:02 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1253726085',display_name='tempest-AttachVolumeNegativeTest-server-1253726085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1253726085',id=34,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnGvkYnZyorUiJqxXvdxoifFTG6MQo2aX6QPuwm2S6OSg8q2DyZRgIWfNNU7KxQdTj8WezhTcNpj4o5/d6t4zoRglpDW6jCf0t5khDjiNWkWkgste5dsdaPFBGYxqW8AQ==',key_name='tempest-keypair-725616642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-p2kyitm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:10:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=afccc0c5-9184-4a0c-a11e-50618b6e528d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=50c67357-42ce-4826-b568-696829fac338,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c67357-42') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.objects.instance [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'pci_devices' on Instance uuid afccc0c5-9184-4a0c-a11e-50618b6e528d {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:10:02 user nova-compute[82184]:   <uuid>afccc0c5-9184-4a0c-a11e-50618b6e528d</uuid>
Apr 12 02:10:02 user nova-compute[82184]:   <name>instance-00000022</name>
Apr 12 02:10:02 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:10:02 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:10:02 user nova-compute[82184]:   <metadata>
Apr 12 02:10:02 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:10:02 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:10:02 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1253726085</nova:name>
Apr 12 02:10:02 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:10:02</nova:creationTime>
Apr 12 02:10:02 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:10:02 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:10:02 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:10:02 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:10:02 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:10:02 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:10:02 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:10:02 user nova-compute[82184]:       <nova:owner>
Apr 12 02:10:02 user nova-compute[82184]:         <nova:user uuid="189b7aba48014bedacfa021cc3cad5e4">tempest-AttachVolumeNegativeTest-1849748479-project-member</nova:user>
Apr 12 02:10:02 user nova-compute[82184]:         <nova:project uuid="2acf278c981e481fbe43e415c76aa6e7">tempest-AttachVolumeNegativeTest-1849748479</nova:project>
Apr 12 02:10:02 user nova-compute[82184]:       </nova:owner>
Apr 12 02:10:02 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:10:02 user nova-compute[82184]:       <nova:ports>
Apr 12 02:10:02 user nova-compute[82184]:         <nova:port uuid="50c67357-42ce-4826-b568-696829fac338">
Apr 12 02:10:02 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 02:10:02 user nova-compute[82184]:         </nova:port>
Apr 12 02:10:02 user nova-compute[82184]:       </nova:ports>
Apr 12 02:10:02 user nova-compute[82184]:     </nova:instance>
Apr 12 02:10:02 user nova-compute[82184]:   </metadata>
Apr 12 02:10:02 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:10:02 user nova-compute[82184]:     <system>
Apr 12 02:10:02 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:10:02 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:10:02 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:10:02 user nova-compute[82184]:       <entry name="serial">afccc0c5-9184-4a0c-a11e-50618b6e528d</entry>
Apr 12 02:10:02 user nova-compute[82184]:       <entry name="uuid">afccc0c5-9184-4a0c-a11e-50618b6e528d</entry>
Apr 12 02:10:02 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:10:02 user nova-compute[82184]:     </system>
Apr 12 02:10:02 user nova-compute[82184]:   </sysinfo>
Apr 12 02:10:02 user nova-compute[82184]:   <os>
Apr 12 02:10:02 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:10:02 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:10:02 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:10:02 user nova-compute[82184]:   </os>
Apr 12 02:10:02 user nova-compute[82184]:   <features>
Apr 12 02:10:02 user nova-compute[82184]:     <acpi/>
Apr 12 02:10:02 user nova-compute[82184]:     <apic/>
Apr 12 02:10:02 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:10:02 user nova-compute[82184]:   </features>
Apr 12 02:10:02 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:10:02 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:10:02 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:10:02 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:10:02 user nova-compute[82184]:   </clock>
Apr 12 02:10:02 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:10:02 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:10:02 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:10:02 user nova-compute[82184]:   </cpu>
Apr 12 02:10:02 user nova-compute[82184]:   <devices>
Apr 12 02:10:02 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:10:02 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:10:02 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk"/>
Apr 12 02:10:02 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:10:02 user nova-compute[82184]:     </disk>
Apr 12 02:10:02 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:10:02 user nova-compute[82184]:       <mac address="fa:16:3e:58:fb:d2"/>
Apr 12 02:10:02 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:10:02 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:10:02 user nova-compute[82184]:       <target dev="tap50c67357-42"/>
Apr 12 02:10:02 user nova-compute[82184]:     </interface>
Apr 12 02:10:02 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:10:02 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/console.log" append="off"/>
Apr 12 02:10:02 user nova-compute[82184]:     </serial>
Apr 12 02:10:02 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:10:02 user nova-compute[82184]:     <video>
Apr 12 02:10:02 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:10:02 user nova-compute[82184]:     </video>
Apr 12 02:10:02 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:10:02 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:10:02 user nova-compute[82184]:     </rng>
Apr 12 02:10:02 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:10:02 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:10:02 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:10:02 user nova-compute[82184]:     </memballoon>
Apr 12 02:10:02 user nova-compute[82184]:   </devices>
Apr 12 02:10:02 user nova-compute[82184]: </domain>
Apr 12 02:10:02 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1253726085',display_name='tempest-AttachVolumeNegativeTest-server-1253726085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1253726085',id=34,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnGvkYnZyorUiJqxXvdxoifFTG6MQo2aX6QPuwm2S6OSg8q2DyZRgIWfNNU7KxQdTj8WezhTcNpj4o5/d6t4zoRglpDW6jCf0t5khDjiNWkWkgste5dsdaPFBGYxqW8AQ==',key_name='tempest-keypair-725616642',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-p2kyitm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:10:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=afccc0c5-9184-4a0c-a11e-50618b6e528d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=50c67357-42ce-4826-b568-696829fac338,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c67357-42') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG os_vif [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=50c67357-42ce-4826-b568-696829fac338,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c67357-42') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50c67357-42, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50c67357-42, col_values=(('external_ids', {'iface-id': '50c67357-42ce-4826-b568-696829fac338', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:fb:d2', 'vm-uuid': 'afccc0c5-9184-4a0c-a11e-50618b6e528d'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:02 user nova-compute[82184]: INFO os_vif [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=50c67357-42ce-4826-b568-696829fac338,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c67357-42')
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No VIF found with MAC fa:16:3e:58:fb:d2, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-8d8e4acc-bb23-4222-aaae-d0e40c47c985 req-0df5c3df-0de6-435b-8f5b-deb1670f0173 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Updated VIF entry in instance network info cache for port 50c67357-42ce-4826-b568-696829fac338. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-8d8e4acc-bb23-4222-aaae-d0e40c47c985 req-0df5c3df-0de6-435b-8f5b-deb1670f0173 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Updating instance_info_cache with network_info: [{"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:10:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8d8e4acc-bb23-4222-aaae-d0e40c47c985 req-0df5c3df-0de6-435b-8f5b-deb1670f0173 service nova] Releasing lock "refresh_cache-afccc0c5-9184-4a0c-a11e-50618b6e528d" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:10:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:10:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-3ee8d5be-ea6b-4b0d-ad75-fcea58d6511b req-42e46f29-ac71-4a4a-8d95-3dca3ca753a8 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received event network-vif-plugged-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:10:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3ee8d5be-ea6b-4b0d-ad75-fcea58d6511b req-42e46f29-ac71-4a4a-8d95-3dca3ca753a8 service nova] Acquiring lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:10:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3ee8d5be-ea6b-4b0d-ad75-fcea58d6511b req-42e46f29-ac71-4a4a-8d95-3dca3ca753a8 service nova] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:10:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3ee8d5be-ea6b-4b0d-ad75-fcea58d6511b req-42e46f29-ac71-4a4a-8d95-3dca3ca753a8 service nova] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:10:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-3ee8d5be-ea6b-4b0d-ad75-fcea58d6511b req-42e46f29-ac71-4a4a-8d95-3dca3ca753a8 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] No waiting events found dispatching network-vif-plugged-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:10:03 user nova-compute[82184]: WARNING nova.compute.manager [req-3ee8d5be-ea6b-4b0d-ad75-fcea58d6511b req-42e46f29-ac71-4a4a-8d95-3dca3ca753a8 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received unexpected event network-vif-plugged-50c67357-42ce-4826-b568-696829fac338 for instance with vm_state building and task_state spawning.
Apr 12 02:10:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265405.6936204, afccc0c5-9184-4a0c-a11e-50618b6e528d => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:10:05 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] VM Resumed (Lifecycle Event)
Apr 12 02:10:05 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Instance spawned successfully.
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:10:05 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265405.6938972, afccc0c5-9184-4a0c-a11e-50618b6e528d => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:10:05 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] VM Started (Lifecycle Event)
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:10:05 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:10:05 user nova-compute[82184]: INFO nova.compute.manager [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Took 5.32 seconds to spawn the instance on the hypervisor.
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-c442920f-3ccf-4e5e-bcf0-449f872d45a0 req-abe5b4bd-702f-4e40-ab5c-a88d65edf495 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received event network-vif-plugged-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c442920f-3ccf-4e5e-bcf0-449f872d45a0 req-abe5b4bd-702f-4e40-ab5c-a88d65edf495 service nova] Acquiring lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c442920f-3ccf-4e5e-bcf0-449f872d45a0 req-abe5b4bd-702f-4e40-ab5c-a88d65edf495 service nova] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c442920f-3ccf-4e5e-bcf0-449f872d45a0 req-abe5b4bd-702f-4e40-ab5c-a88d65edf495 service nova] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:10:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-c442920f-3ccf-4e5e-bcf0-449f872d45a0 req-abe5b4bd-702f-4e40-ab5c-a88d65edf495 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] No waiting events found dispatching network-vif-plugged-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:10:05 user nova-compute[82184]: WARNING nova.compute.manager [req-c442920f-3ccf-4e5e-bcf0-449f872d45a0 req-abe5b4bd-702f-4e40-ab5c-a88d65edf495 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received unexpected event network-vif-plugged-50c67357-42ce-4826-b568-696829fac338 for instance with vm_state active and task_state None.
Apr 12 02:10:05 user nova-compute[82184]: INFO nova.compute.manager [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Took 5.93 seconds to build instance.
Apr 12 02:10:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-da4d6d48-f767-44dd-ab99-58cc787ba951 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.019s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:10:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:10:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:10:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:10:56 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:10:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:10:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:10:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8407MB free_disk=26.479816436767578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:10:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 1a3c868f-3a4c-430e-8009-7a855e832f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e4ae774a-0f87-4d51-a997-c8f9b228fe71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 2f23b57e-3bf8-442a-8072-2ae145f9104a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance afccc0c5-9184-4a0c-a11e-50618b6e528d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1216MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:10:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:11:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:11:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:11:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:11:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:11:00 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:11:00 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 1a3c868f-3a4c-430e-8009-7a855e832f82 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:11:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updating instance_info_cache with network_info: [{"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:11:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-1a3c868f-3a4c-430e-8009-7a855e832f82" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:11:01 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:11:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:01 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:11:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:11:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:11:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:11:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:11:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:11:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:11:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:07 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:11:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:11:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "2f23b57e-3bf8-442a-8072-2ae145f9104a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:11:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:11:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:11:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:11:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:11:19 user nova-compute[82184]: INFO nova.compute.manager [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Terminating instance
Apr 12 02:11:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG nova.compute.manager [req-766b63d0-8738-45be-8594-3420ee8005f2 req-b661c4e6-325c-4261-9d01-295cb1386e19 service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Received event network-vif-unplugged-1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-766b63d0-8738-45be-8594-3420ee8005f2 req-b661c4e6-325c-4261-9d01-295cb1386e19 service nova] Acquiring lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-766b63d0-8738-45be-8594-3420ee8005f2 req-b661c4e6-325c-4261-9d01-295cb1386e19 service nova] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-766b63d0-8738-45be-8594-3420ee8005f2 req-b661c4e6-325c-4261-9d01-295cb1386e19 service nova] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG nova.compute.manager [req-766b63d0-8738-45be-8594-3420ee8005f2 req-b661c4e6-325c-4261-9d01-295cb1386e19 service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] No waiting events found dispatching network-vif-unplugged-1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG nova.compute.manager [req-766b63d0-8738-45be-8594-3420ee8005f2 req-b661c4e6-325c-4261-9d01-295cb1386e19 service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Received event network-vif-unplugged-1535b023-7f14-4e27-9691-f6728b943cfe for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:20 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Instance destroyed successfully.
Apr 12 02:11:20 user nova-compute[82184]: DEBUG nova.objects.instance [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'resources' on Instance uuid 2f23b57e-3bf8-442a-8072-2ae145f9104a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2306241',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2306241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2306241',id=33,image_ref='594e2609-87fd-4742-9919-8292fb3c9aa4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:09:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-0cobontw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2043953815',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:09:45Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=2f23b57e-3bf8-442a-8072-2ae145f9104a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1535b023-7f14-4e27-9691-f6728b943cfe", "address": "fa:16:3e:23:90:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1535b023-7f", "ovs_interfaceid": "1535b023-7f14-4e27-9691-f6728b943cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "1535b023-7f14-4e27-9691-f6728b943cfe", "address": "fa:16:3e:23:90:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1535b023-7f", "ovs_interfaceid": "1535b023-7f14-4e27-9691-f6728b943cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:90:d5,bridge_name='br-int',has_traffic_filtering=True,id=1535b023-7f14-4e27-9691-f6728b943cfe,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1535b023-7f') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_vif [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:90:d5,bridge_name='br-int',has_traffic_filtering=True,id=1535b023-7f14-4e27-9691-f6728b943cfe,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1535b023-7f') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1535b023-7f, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:11:20 user nova-compute[82184]: INFO os_vif [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:90:d5,bridge_name='br-int',has_traffic_filtering=True,id=1535b023-7f14-4e27-9691-f6728b943cfe,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1535b023-7f')
Apr 12 02:11:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uMEWbHYe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:11:20 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63fb5f5-f58c-4b08-8304-ab9f28b5d9d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:11:20 user nova-compute[82184]: No targets found.
Apr 12 02:11:20 user nova-compute[82184]: iSNS:
Apr 12 02:11:20 user nova-compute[82184]: No targets found.
Apr 12 02:11:20 user nova-compute[82184]: STATIC:
Apr 12 02:11:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194
Apr 12 02:11:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:11:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:11:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b
Apr 12 02:11:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:11:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:11:20 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98
Apr 12 02:11:20 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:11:20 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:11:20 user nova-compute[82184]: FIRMWARE:
Apr 12 02:11:20 user nova-compute[82184]: No targets found.
Apr 12 02:11:20 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:11:20 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:11:20 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d4766a-ee42-4deb-845a-cc6a2f2dc6a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d961ce-083f-4f05-b62e-200b3cfbfa9c]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:11:20 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:11:20 user nova-compute[82184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b (non-flash)
Apr 12 02:11:20 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:11:20 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:11:20 user nova-compute[82184]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b (non-flash)
Apr 12 02:11:20 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a85ed120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5b6b2a-cb52-4ff5-bf22-857225585d7e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[982d0a7a-ae64-43d4-a999-e9a598b65880]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd8ed27-d85d-40e8-b422-a357e69b6858]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2143d2-571a-4918-848a-87b185a5b902]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e947cee9', '/dev/disk/by-id/scsi-1SCST_BIOe947cee9-8748c1688c2a507d', '/dev/disk/by-id/scsi-23837343863313638') {{(pid=92498) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a61317-04eb-4d95-870d-f749ea5bddf1]: (4, None) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:11:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5151b6-6ade-4e20-aef8-c07636e0c9b4]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9959d5f8-fee0-4e93-bdba-deef62140688]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b, portal: 172.16.0.220,3260]
Apr 12 02:11:21 user nova-compute[82184]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b, portal: 172.16.0.220,3260] successful.
Apr 12 02:11:21 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fda3311-9867-4a4c-aba5-cb351634580b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef4b554-e247-4069-887f-a1bfb8c92039]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== disconnect_volume: return (301ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:11:21 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Deleting instance files /opt/stack/data/nova/instances/2f23b57e-3bf8-442a-8072-2ae145f9104a_del
Apr 12 02:11:21 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Deletion of /opt/stack/data/nova/instances/2f23b57e-3bf8-442a-8072-2ae145f9104a_del complete
Apr 12 02:11:21 user nova-compute[82184]: INFO nova.compute.manager [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 12 02:11:21 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:11:21 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:11:21 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Took 0.64 seconds to deallocate network for instance.
Apr 12 02:11:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-dfcd14b1-11a5-452c-a2cd-08fa408b766c req-5cae1fa6-4b26-4c91-affd-3130bc5c1f8b service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Received event network-vif-plugged-1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:11:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-dfcd14b1-11a5-452c-a2cd-08fa408b766c req-5cae1fa6-4b26-4c91-affd-3130bc5c1f8b service nova] Acquiring lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:11:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-dfcd14b1-11a5-452c-a2cd-08fa408b766c req-5cae1fa6-4b26-4c91-affd-3130bc5c1f8b service nova] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:11:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-dfcd14b1-11a5-452c-a2cd-08fa408b766c req-5cae1fa6-4b26-4c91-affd-3130bc5c1f8b service nova] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:11:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-dfcd14b1-11a5-452c-a2cd-08fa408b766c req-5cae1fa6-4b26-4c91-affd-3130bc5c1f8b service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] No waiting events found dispatching network-vif-plugged-1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:11:22 user nova-compute[82184]: WARNING nova.compute.manager [req-dfcd14b1-11a5-452c-a2cd-08fa408b766c req-5cae1fa6-4b26-4c91-affd-3130bc5c1f8b service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Received unexpected event network-vif-plugged-1535b023-7f14-4e27-9691-f6728b943cfe for instance with vm_state active and task_state deleting.
Apr 12 02:11:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-dfcd14b1-11a5-452c-a2cd-08fa408b766c req-5cae1fa6-4b26-4c91-affd-3130bc5c1f8b service nova] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Received event network-vif-deleted-1535b023-7f14-4e27-9691-f6728b943cfe {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:11:22 user nova-compute[82184]: INFO nova.compute.manager [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Took 0.77 seconds to detach 1 volumes for instance.
Apr 12 02:11:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Deleting volume: 0fda3311-9867-4a4c-aba5-cb351634580b {{(pid=82184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 02:11:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:11:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:11:22 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:11:22 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:11:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:11:23 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Deleted allocations for instance 2f23b57e-3bf8-442a-8072-2ae145f9104a
Apr 12 02:11:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-faf77b52-e62e-4326-bb00-417f55aed79a tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "2f23b57e-3bf8-442a-8072-2ae145f9104a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.152s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:11:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:35 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265480.7292278, 2f23b57e-3bf8-442a-8072-2ae145f9104a => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:11:35 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] VM Stopped (Lifecycle Event)
Apr 12 02:11:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bbb8d305-24c0-4602-8904-3b3268d94c3b None None] [instance: 2f23b57e-3bf8-442a-8072-2ae145f9104a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:11:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:11:38 user nova-compute[82184]: INFO nova.compute.manager [None req-dc20e2bc-f16a-4609-9eec-78a5a411ed7a tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Get console output
Apr 12 02:11:38 user nova-compute[82184]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 12 02:11:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-b3c4395d-6078-41ef-aaa6-fffd3958e94f req-8d4f0460-31b0-4eb8-a360-74762c4c6900 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received event network-changed-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:11:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-b3c4395d-6078-41ef-aaa6-fffd3958e94f req-8d4f0460-31b0-4eb8-a360-74762c4c6900 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Refreshing instance network info cache due to event network-changed-50c67357-42ce-4826-b568-696829fac338. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:11:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b3c4395d-6078-41ef-aaa6-fffd3958e94f req-8d4f0460-31b0-4eb8-a360-74762c4c6900 service nova] Acquiring lock "refresh_cache-afccc0c5-9184-4a0c-a11e-50618b6e528d" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:11:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b3c4395d-6078-41ef-aaa6-fffd3958e94f req-8d4f0460-31b0-4eb8-a360-74762c4c6900 service nova] Acquired lock "refresh_cache-afccc0c5-9184-4a0c-a11e-50618b6e528d" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:11:50 user nova-compute[82184]: DEBUG nova.network.neutron [req-b3c4395d-6078-41ef-aaa6-fffd3958e94f req-8d4f0460-31b0-4eb8-a360-74762c4c6900 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Refreshing network info cache for port 50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:11:51 user nova-compute[82184]: DEBUG nova.network.neutron [req-b3c4395d-6078-41ef-aaa6-fffd3958e94f req-8d4f0460-31b0-4eb8-a360-74762c4c6900 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Updated VIF entry in instance network info cache for port 50c67357-42ce-4826-b568-696829fac338. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:11:51 user nova-compute[82184]: DEBUG nova.network.neutron [req-b3c4395d-6078-41ef-aaa6-fffd3958e94f req-8d4f0460-31b0-4eb8-a360-74762c4c6900 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Updating instance_info_cache with network_info: [{"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:11:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b3c4395d-6078-41ef-aaa6-fffd3958e94f req-8d4f0460-31b0-4eb8-a360-74762c4c6900 service nova] Releasing lock "refresh_cache-afccc0c5-9184-4a0c-a11e-50618b6e528d" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:11:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'flavor' on Instance uuid afccc0c5-9184-4a0c-a11e-50618b6e528d {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:11:52 user nova-compute[82184]: INFO nova.compute.manager [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Attaching volume da4c81dd-019a-4266-b972-a31e79e201c9 to /dev/vdb
Apr 12 02:11:52 user nova-compute[82184]: DEBUG os_brick.utils [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4267d9-d635-4eed-942a-0c61f7c52e2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2530e91-4168-43e6-9d09-60739397a6ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccbc341-df38-4a6c-ae40-09af6acc3915]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7f7525-4a74-4753-925c-267f1b16fe77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:11:52 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:11:52 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f7fbb4-beec-4334-80d9-191868b19e42]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG os_brick.utils [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:11:52 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Updating existing volume attachment record: 61e80d10-3574-452b-9bef-0a55fe213a5c {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:11:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:11:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNihzsbY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:11:57 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:11:57 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:11:57 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78883e3f-0020-4b7f-bbac-0166cf6d9382]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:11:57 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6784d1-1e3e-4414-991f-eba23460bffe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9] added
Apr 12 02:11:57 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9664f4-5699-4518-b3ee-9edf7fd151bf]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd587a83-e762-479b-8563-c72e851854ed]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNihzsbY {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNihzsbY" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1c6f87-ba2d-49bb-aa8a-cd4f3a45b50a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mNihzsbY'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd2b44f-5224-4b38-91a8-ae8154dcaf69]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08331fe-b810-4b01-ac02-315a4ac73dd1]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:11:57 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:11:57 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:11:57 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:11:57 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c89b8-2eb9-4e00-b8e7-732ddd20b5b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9, portal: 172.16.0.220,3260]
Apr 12 02:11:57 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9, portal: 172.16.0.220,3260] successful.
Apr 12 02:11:57 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[697b9a5c-852e-4033-a6c2-6b4a8f6fcf02]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b5ae58-77a5-4dc7-a8b3-a364f1f62fdd]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:11:57 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:11:57 user nova-compute[82184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 (non-flash)
Apr 12 02:11:57 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:11:57 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:11:57 user nova-compute[82184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 (non-flash)
Apr 12 02:11:57 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b3c76b-4f37-47ab-b4ff-b77ea411d7d6]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNihzsbY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:11:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23535666361633962', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535666361633962', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'flavor' on Instance uuid afccc0c5-9184-4a0c-a11e-50618b6e528d {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:11:58 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:11:58 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:11:58 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:11:58 user nova-compute[82184]:   <serial>da4c81dd-019a-4266-b972-a31e79e201c9</serial>
Apr 12 02:11:58 user nova-compute[82184]: </disk>
Apr 12 02:11:58 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:11:58 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:11:58 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:11:58 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8481MB free_disk=26.462936401367188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:11:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] No VIF found with MAC fa:16:3e:58:fb:d2, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a532d06f-ac1c-4358-ab56-d174644f8141 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.602s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 1a3c868f-3a4c-430e-8009-7a855e832f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e4ae774a-0f87-4d51-a997-c8f9b228fe71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance afccc0c5-9184-4a0c-a11e-50618b6e528d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:11:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:00 user nova-compute[82184]: INFO nova.compute.manager [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Detaching volume da4c81dd-019a-4266-b972-a31e79e201c9
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:12:00 user nova-compute[82184]: INFO nova.virt.block_device [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Attempting to driver detach volume da4c81dd-019a-4266-b972-a31e79e201c9 from mountpoint /dev/vdb
Apr 12 02:12:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Attempting to detach device vdb from instance afccc0c5-9184-4a0c-a11e-50618b6e528d from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:12:00 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:12:00 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:12:00 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:12:00 user nova-compute[82184]:   <serial>da4c81dd-019a-4266-b972-a31e79e201c9</serial>
Apr 12 02:12:00 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:12:00 user nova-compute[82184]: </disk>
Apr 12 02:12:00 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:12:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully detached device vdb from instance afccc0c5-9184-4a0c-a11e-50618b6e528d from the persistent domain config.
Apr 12 02:12:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afccc0c5-9184-4a0c-a11e-50618b6e528d from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:12:00 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:12:00 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:12:00 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:12:00 user nova-compute[82184]:   <serial>da4c81dd-019a-4266-b972-a31e79e201c9</serial>
Apr 12 02:12:00 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:12:00 user nova-compute[82184]: </disk>
Apr 12 02:12:00 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681265520.8976138, afccc0c5-9184-4a0c-a11e-50618b6e528d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afccc0c5-9184-4a0c-a11e-50618b6e528d {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:12:00 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully detached device vdb from instance afccc0c5-9184-4a0c-a11e-50618b6e528d from the live domain config.
Apr 12 02:12:00 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNihzsbY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:12:00 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:12:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0ad29a-932e-4425-a59d-2bd046b65024]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:12:00 user nova-compute[82184]: No targets found.
Apr 12 02:12:00 user nova-compute[82184]: iSNS:
Apr 12 02:12:00 user nova-compute[82184]: No targets found.
Apr 12 02:12:00 user nova-compute[82184]: STATIC:
Apr 12 02:12:00 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194
Apr 12 02:12:00 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:12:00 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:12:00 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9
Apr 12 02:12:00 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:12:00 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:12:00 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98
Apr 12 02:12:00 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:12:00 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:12:00 user nova-compute[82184]: FIRMWARE:
Apr 12 02:12:00 user nova-compute[82184]: No targets found.
Apr 12 02:12:00 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:12:00 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:12:00 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba86c9ee-9a50-4986-b149-e858a2b518d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41f7100-e9db-4ab8-aabe-06baf280dff5]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:12:00 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:12:00 user nova-compute[82184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 (non-flash)
Apr 12 02:12:00 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:12:00 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:12:00 user nova-compute[82184]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 (non-flash)
Apr 12 02:12:00 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a80cd870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:12:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4462d5-93a9-4868-8783-4f5a2708394e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating instance_info_cache with network_info: [{"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecf8983-ac82-41e6-b493-40d66a1f0c8a]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-e4ae774a-0f87-4d51-a997-c8f9b228fe71" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7bea11-78bf-4bdc-a966-a9db2a27b36e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2d564-c8ef-4c1c-8f9d-98863dd9a255]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[db75341c-3a05-4907-8d9f-8b567e7c7fc5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[968e4a73-941c-4949-a584-789c3439bec3]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9, portal: 172.16.0.220,3260]
Apr 12 02:12:01 user nova-compute[82184]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9, portal: 172.16.0.220,3260] successful.
Apr 12 02:12:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da4c81dd-019a-4266-b972-a31e79e201c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56dc6a1-fb0f-40ff-b07f-47900c6cbacc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] <== disconnect_volume: return (306ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:02 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'flavor' on Instance uuid afccc0c5-9184-4a0c-a11e-50618b6e528d {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:12:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b5e21ba7-7a84-4125-bc62-5f9c4d00a7a9 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.707s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:05 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:12:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:12 user nova-compute[82184]: INFO nova.compute.manager [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Terminating instance
Apr 12 02:12:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-be6413a8-d2a1-434b-b55f-954c38771383 req-9350aa9e-66fd-4455-88bd-a7d514ac082e service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Received event network-vif-unplugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-be6413a8-d2a1-434b-b55f-954c38771383 req-9350aa9e-66fd-4455-88bd-a7d514ac082e service nova] Acquiring lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-be6413a8-d2a1-434b-b55f-954c38771383 req-9350aa9e-66fd-4455-88bd-a7d514ac082e service nova] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-be6413a8-d2a1-434b-b55f-954c38771383 req-9350aa9e-66fd-4455-88bd-a7d514ac082e service nova] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-be6413a8-d2a1-434b-b55f-954c38771383 req-9350aa9e-66fd-4455-88bd-a7d514ac082e service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] No waiting events found dispatching network-vif-unplugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:12:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-be6413a8-d2a1-434b-b55f-954c38771383 req-9350aa9e-66fd-4455-88bd-a7d514ac082e service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Received event network-vif-unplugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:13 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Instance destroyed successfully.
Apr 12 02:12:13 user nova-compute[82184]: DEBUG nova.objects.instance [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'resources' on Instance uuid fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:07:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1293359077',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1293359077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1293359077',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-2793540h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:07:47Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "address": "fa:16:3e:ce:1f:3e", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7679d13-0b", "ovs_interfaceid": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "address": "fa:16:3e:ce:1f:3e", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7679d13-0b", "ovs_interfaceid": "e7679d13-0bc6-48e2-83ad-5a1c9fe8445c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1f:3e,bridge_name='br-int',has_traffic_filtering=True,id=e7679d13-0bc6-48e2-83ad-5a1c9fe8445c,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7679d13-0b') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_vif [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1f:3e,bridge_name='br-int',has_traffic_filtering=True,id=e7679d13-0bc6-48e2-83ad-5a1c9fe8445c,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7679d13-0b') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7679d13-0b, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:12:13 user nova-compute[82184]: INFO os_vif [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:1f:3e,bridge_name='br-int',has_traffic_filtering=True,id=e7679d13-0bc6-48e2-83ad-5a1c9fe8445c,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7679d13-0b')
Apr 12 02:12:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kjulQIFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:12:13 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a28b9c-ee09-4ea8-b3e6-f0e2dad4ee61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:12:13 user nova-compute[82184]: No targets found.
Apr 12 02:12:13 user nova-compute[82184]: iSNS:
Apr 12 02:12:13 user nova-compute[82184]: No targets found.
Apr 12 02:12:13 user nova-compute[82184]: STATIC:
Apr 12 02:12:13 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194
Apr 12 02:12:13 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:12:13 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:12:13 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98
Apr 12 02:12:13 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:12:13 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:12:13 user nova-compute[82184]: FIRMWARE:
Apr 12 02:12:13 user nova-compute[82184]: No targets found.
Apr 12 02:12:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:12:13 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:12:13 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06dedd0-48c6-42c4-b560-1a327b695109]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd025971-e6fd-4543-8a0d-f75070f031c0]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:12:13 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:12:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 (non-flash)
Apr 12 02:12:13 user nova-compute[82184]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:12:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a81e3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98'): ({'sdc'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Removing single pathed devices sdc {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadd50f2-b876-4fca-a683-118f98737374]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf95628d-7a73-4a3e-910c-75de95394723]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flushing IO for device /dev/sdc {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48764b4-089f-445b-b875-95918933d2d0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[df595acb-cd87-4c0e-ae3c-0551e03e1219]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d159c6-c06a-4555-b9be-bdf5f5d269bc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491a841-7fb7-4fc7-adf2-ccf467485d8e]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98, portal: 172.16.0.220,3260]
Apr 12 02:12:13 user nova-compute[82184]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98, portal: 172.16.0.220,3260] successful.
Apr 12 02:12:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a91e0965-aef8-40da-921c-cd9566b59a98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c6d994-8c82-4771-a121-1382af2bc0f6]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== disconnect_volume: return (316ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:12:13 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Deleting instance files /opt/stack/data/nova/instances/fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c_del
Apr 12 02:12:13 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Deletion of /opt/stack/data/nova/instances/fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c_del complete
Apr 12 02:12:13 user nova-compute[82184]: INFO nova.compute.manager [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 12 02:12:13 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:12:13 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:12:14 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:12:14 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Took 0.46 seconds to deallocate network for instance.
Apr 12 02:12:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-fedd6d3b-cf01-4cdb-af2a-ad275fc2696a req-9ab8317d-ed27-44b5-98fc-b05f91b5f024 service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Received event network-vif-deleted-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:12:14 user nova-compute[82184]: INFO nova.compute.manager [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Took 0.74 seconds to detach 1 volumes for instance.
Apr 12 02:12:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Deleting volume: a91e0965-aef8-40da-921c-cd9566b59a98 {{(pid=82184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 02:12:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-27f1cfba-041e-424b-8d06-78afbc7fc1d9 req-35be83da-d444-48ad-b0d1-cd42f7ea5bc8 service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Received event network-vif-plugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:12:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-27f1cfba-041e-424b-8d06-78afbc7fc1d9 req-35be83da-d444-48ad-b0d1-cd42f7ea5bc8 service nova] Acquiring lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-27f1cfba-041e-424b-8d06-78afbc7fc1d9 req-35be83da-d444-48ad-b0d1-cd42f7ea5bc8 service nova] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-27f1cfba-041e-424b-8d06-78afbc7fc1d9 req-35be83da-d444-48ad-b0d1-cd42f7ea5bc8 service nova] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-27f1cfba-041e-424b-8d06-78afbc7fc1d9 req-35be83da-d444-48ad-b0d1-cd42f7ea5bc8 service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] No waiting events found dispatching network-vif-plugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:12:14 user nova-compute[82184]: WARNING nova.compute.manager [req-27f1cfba-041e-424b-8d06-78afbc7fc1d9 req-35be83da-d444-48ad-b0d1-cd42f7ea5bc8 service nova] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Received unexpected event network-vif-plugged-e7679d13-0bc6-48e2-83ad-5a1c9fe8445c for instance with vm_state active and task_state deleting.
Apr 12 02:12:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:15 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:12:15 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:12:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:15 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Deleted allocations for instance fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c
Apr 12 02:12:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1a5b716d-edaf-4162-8f60-c3b8ead6830f tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.806s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:28 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265533.3121824, fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:12:28 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] VM Stopped (Lifecycle Event)
Apr 12 02:12:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-381ae69e-485b-4282-86a0-1024f02b0fc8 None None] [instance: fd0e54b9-aff2-4d86-ba56-b5eb7654ac9c] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:12:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:39 user nova-compute[82184]: INFO nova.compute.manager [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Terminating instance
Apr 12 02:12:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-186b192c-0d29-464e-85df-3e2f4184a9de req-033ea1dc-dc79-4a82-a3c8-de27f14a42f5 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-vif-unplugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-186b192c-0d29-464e-85df-3e2f4184a9de req-033ea1dc-dc79-4a82-a3c8-de27f14a42f5 service nova] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-186b192c-0d29-464e-85df-3e2f4184a9de req-033ea1dc-dc79-4a82-a3c8-de27f14a42f5 service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-186b192c-0d29-464e-85df-3e2f4184a9de req-033ea1dc-dc79-4a82-a3c8-de27f14a42f5 service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-186b192c-0d29-464e-85df-3e2f4184a9de req-033ea1dc-dc79-4a82-a3c8-de27f14a42f5 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] No waiting events found dispatching network-vif-unplugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-186b192c-0d29-464e-85df-3e2f4184a9de req-033ea1dc-dc79-4a82-a3c8-de27f14a42f5 service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-vif-unplugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:39 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Instance destroyed successfully.
Apr 12 02:12:39 user nova-compute[82184]: DEBUG nova.objects.instance [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'resources' on Instance uuid e4ae774a-0f87-4d51-a997-c8f9b228fe71 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1038265517',display_name='tempest-ServerActionsTestJSON-server-1038265517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1038265517',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:08:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-ock7vvu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:09:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=e4ae774a-0f87-4d51-a997-c8f9b228fe71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "address": "fa:16:3e:70:e2:e8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a5774-7c", "ovs_interfaceid": "ce1a5774-7c99-4d64-b16b-2dab8491ff6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_vif [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce1a5774-7c, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:12:39 user nova-compute[82184]: INFO os_vif [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:e2:e8,bridge_name='br-int',has_traffic_filtering=True,id=ce1a5774-7c99-4d64-b16b-2dab8491ff6d,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a5774-7c')
Apr 12 02:12:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rXubagWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:12:39 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9302354c-dfda-40d7-9748-1c8d95ef6f2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:12:39 user nova-compute[82184]: No targets found.
Apr 12 02:12:39 user nova-compute[82184]: iSNS:
Apr 12 02:12:39 user nova-compute[82184]: No targets found.
Apr 12 02:12:39 user nova-compute[82184]: STATIC:
Apr 12 02:12:39 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194
Apr 12 02:12:39 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:12:39 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:12:39 user nova-compute[82184]: FIRMWARE:
Apr 12 02:12:39 user nova-compute[82184]: No targets found.
Apr 12 02:12:39 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:12:39 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:12:39 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa347ca1-389e-42dc-9519-64c951c82559]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12b1e95-06f6-46ae-9f24-d0d0f6e6dd71]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:12:39 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 (non-flash)
Apr 12 02:12:39 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a85ec160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194'): ({'sdd'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Removing single pathed devices sdd {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b9603a-e7c2-494c-9c9a-b2b0ff703081]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[50485939-b866-45a7-bd4e-a8a5712b5f74]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Flushing IO for device /dev/sdd {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8740abc9-f8ca-411f-a337-e682fc757f83]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8141c68-ff86-4154-87e9-193656e495c8]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9363a5e0-dfe78bbae1e9cb9b', '/dev/disk/by-id/scsi-26466653738626261', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9363a5e0') {{(pid=92498) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c695f64-0ea4-4ab7-b36d-f6361e6ffef8]: (4, None) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d315d47-8cd5-4d29-8b9a-a483d8f5592d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:12:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3941369-7630-41d3-a0b3-787909c27b5c]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260]
Apr 12 02:12:40 user nova-compute[82184]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194, portal: 172.16.0.220,3260] successful.
Apr 12 02:12:40 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136ed599-e72b-4d77-ad6e-104c14c24194 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccc3ddd-d75f-427f-8237-1d787e4fc7a3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] <== disconnect_volume: return (312ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:12:40 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Deleting instance files /opt/stack/data/nova/instances/e4ae774a-0f87-4d51-a997-c8f9b228fe71_del
Apr 12 02:12:40 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Deletion of /opt/stack/data/nova/instances/e4ae774a-0f87-4d51-a997-c8f9b228fe71_del complete
Apr 12 02:12:40 user nova-compute[82184]: INFO nova.compute.manager [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 12 02:12:40 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:12:40 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:12:40 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Took 0.67 seconds to deallocate network for instance.
Apr 12 02:12:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-d274193b-e619-40fe-8d18-1d9ff10c84ea req-8760c34a-6fb8-4b19-b9f3-52df15e4e2bf service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:12:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d274193b-e619-40fe-8d18-1d9ff10c84ea req-8760c34a-6fb8-4b19-b9f3-52df15e4e2bf service nova] Acquiring lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d274193b-e619-40fe-8d18-1d9ff10c84ea req-8760c34a-6fb8-4b19-b9f3-52df15e4e2bf service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d274193b-e619-40fe-8d18-1d9ff10c84ea req-8760c34a-6fb8-4b19-b9f3-52df15e4e2bf service nova] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-d274193b-e619-40fe-8d18-1d9ff10c84ea req-8760c34a-6fb8-4b19-b9f3-52df15e4e2bf service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] No waiting events found dispatching network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:12:41 user nova-compute[82184]: WARNING nova.compute.manager [req-d274193b-e619-40fe-8d18-1d9ff10c84ea req-8760c34a-6fb8-4b19-b9f3-52df15e4e2bf service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received unexpected event network-vif-plugged-ce1a5774-7c99-4d64-b16b-2dab8491ff6d for instance with vm_state active and task_state deleting.
Apr 12 02:12:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-d274193b-e619-40fe-8d18-1d9ff10c84ea req-8760c34a-6fb8-4b19-b9f3-52df15e4e2bf service nova] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Received event network-vif-deleted-ce1a5774-7c99-4d64-b16b-2dab8491ff6d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:12:41 user nova-compute[82184]: INFO nova.compute.manager [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Took 0.78 seconds to detach 1 volumes for instance.
Apr 12 02:12:41 user nova-compute[82184]: DEBUG nova.compute.manager [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Deleting volume: 136ed599-e72b-4d77-ad6e-104c14c24194 {{(pid=82184) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 02:12:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:41 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:12:41 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:12:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:41 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Deleted allocations for instance e4ae774a-0f87-4d51-a997-c8f9b228fe71
Apr 12 02:12:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-eb1f4cd0-ae4d-4fe8-a627-648fb3b8415e tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "e4ae774a-0f87-4d51-a997-c8f9b228fe71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.020s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:50 user nova-compute[82184]: INFO nova.compute.manager [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Terminating instance
Apr 12 02:12:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:12:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-f19c3531-aa70-4e32-b96b-6c2aeeb2b091 req-ba14c33c-fd77-49c8-b436-35cb3d8e6439 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received event network-vif-unplugged-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f19c3531-aa70-4e32-b96b-6c2aeeb2b091 req-ba14c33c-fd77-49c8-b436-35cb3d8e6439 service nova] Acquiring lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f19c3531-aa70-4e32-b96b-6c2aeeb2b091 req-ba14c33c-fd77-49c8-b436-35cb3d8e6439 service nova] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f19c3531-aa70-4e32-b96b-6c2aeeb2b091 req-ba14c33c-fd77-49c8-b436-35cb3d8e6439 service nova] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-f19c3531-aa70-4e32-b96b-6c2aeeb2b091 req-ba14c33c-fd77-49c8-b436-35cb3d8e6439 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] No waiting events found dispatching network-vif-unplugged-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-f19c3531-aa70-4e32-b96b-6c2aeeb2b091 req-ba14c33c-fd77-49c8-b436-35cb3d8e6439 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received event network-vif-unplugged-50c67357-42ce-4826-b568-696829fac338 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Instance destroyed successfully.
Apr 12 02:12:51 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lazy-loading 'resources' on Instance uuid afccc0c5-9184-4a0c-a11e-50618b6e528d {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:09:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1253726085',display_name='tempest-AttachVolumeNegativeTest-server-1253726085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1253726085',id=34,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnGvkYnZyorUiJqxXvdxoifFTG6MQo2aX6QPuwm2S6OSg8q2DyZRgIWfNNU7KxQdTj8WezhTcNpj4o5/d6t4zoRglpDW6jCf0t5khDjiNWkWkgste5dsdaPFBGYxqW8AQ==',key_name='tempest-keypair-725616642',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2acf278c981e481fbe43e415c76aa6e7',ramdisk_id='',reservation_id='r-p2kyitm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1849748479',owner_user_name='tempest-AttachVolumeNegativeTest-1849748479-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189b7aba48014bedacfa021cc3cad5e4',uuid=afccc0c5-9184-4a0c-a11e-50618b6e528d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converting VIF {"id": "50c67357-42ce-4826-b568-696829fac338", "address": "fa:16:3e:58:fb:d2", "network": {"id": "0875dfb2-68e9-4a37-8295-74f038cfba9a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-783334667-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2acf278c981e481fbe43e415c76aa6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50c67357-42", "ovs_interfaceid": "50c67357-42ce-4826-b568-696829fac338", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=50c67357-42ce-4826-b568-696829fac338,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c67357-42') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG os_vif [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=50c67357-42ce-4826-b568-696829fac338,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c67357-42') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50c67357-42, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:12:51 user nova-compute[82184]: INFO os_vif [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=50c67357-42ce-4826-b568-696829fac338,network=Network(0875dfb2-68e9-4a37-8295-74f038cfba9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50c67357-42')
Apr 12 02:12:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Deleting instance files /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d_del
Apr 12 02:12:51 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Deletion of /opt/stack/data/nova/instances/afccc0c5-9184-4a0c-a11e-50618b6e528d_del complete
Apr 12 02:12:51 user nova-compute[82184]: INFO nova.compute.manager [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 12 02:12:51 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:12:51 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:12:52 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:12:52 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Took 0.82 seconds to deallocate network for instance.
Apr 12 02:12:52 user nova-compute[82184]: DEBUG nova.compute.manager [req-4522b442-d693-4129-892b-a8e31e09f138 req-330336f9-1e62-4721-ac8e-750b2ef27d0f service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received event network-vif-deleted-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:12:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:52 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:12:52 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:12:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:52 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Deleted allocations for instance afccc0c5-9184-4a0c-a11e-50618b6e528d
Apr 12 02:12:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81572d32-2746-4f43-a618-4655ffd315f6 tempest-AttachVolumeNegativeTest-1849748479 tempest-AttachVolumeNegativeTest-1849748479-project-member] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-b62bbda0-9f56-4188-8c50-f40232b751d2 req-f177fd07-73d4-4191-8b7e-6f45d0fc27c4 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received event network-vif-plugged-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:12:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b62bbda0-9f56-4188-8c50-f40232b751d2 req-f177fd07-73d4-4191-8b7e-6f45d0fc27c4 service nova] Acquiring lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b62bbda0-9f56-4188-8c50-f40232b751d2 req-f177fd07-73d4-4191-8b7e-6f45d0fc27c4 service nova] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b62bbda0-9f56-4188-8c50-f40232b751d2 req-f177fd07-73d4-4191-8b7e-6f45d0fc27c4 service nova] Lock "afccc0c5-9184-4a0c-a11e-50618b6e528d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-b62bbda0-9f56-4188-8c50-f40232b751d2 req-f177fd07-73d4-4191-8b7e-6f45d0fc27c4 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] No waiting events found dispatching network-vif-plugged-50c67357-42ce-4826-b568-696829fac338 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:12:53 user nova-compute[82184]: WARNING nova.compute.manager [req-b62bbda0-9f56-4188-8c50-f40232b751d2 req-f177fd07-73d4-4191-8b7e-6f45d0fc27c4 service nova] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Received unexpected event network-vif-plugged-50c67357-42ce-4826-b568-696829fac338 for instance with vm_state deleted and task_state None.
Apr 12 02:12:54 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265559.7350068, e4ae774a-0f87-4d51-a997-c8f9b228fe71 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:12:54 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] VM Stopped (Lifecycle Event)
Apr 12 02:12:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-9d61676f-4fe7-48eb-a6f5-406ae5ad1023 None None] [instance: e4ae774a-0f87-4d51-a997-c8f9b228fe71] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:12:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:12:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:59 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:12:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:12:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:12:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:12:59 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:12:59 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:00 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:13:00 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:13:00 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8684MB free_disk=26.481246948242188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 1a3c868f-3a4c-430e-8009-7a855e832f82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:13:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:13:01 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:13:01 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:13:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:13:06 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265571.4682965, afccc0c5-9184-4a0c-a11e-50618b6e528d => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:13:06 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] VM Stopped (Lifecycle Event)
Apr 12 02:13:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-47e63f42-daf4-4367-9e46-74177d321bab None None] [instance: afccc0c5-9184-4a0c-a11e-50618b6e528d] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:13:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:13:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:13:07 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:13:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:13:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "fc88ac73-1963-4055-bd73-7a51c0850528" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fc88ac73-1963-4055-bd73-7a51c0850528" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:08 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:13:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:08 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:13:08 user nova-compute[82184]: INFO nova.compute.claims [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Claim successful on node user
Apr 12 02:13:08 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:13:08 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:13:09 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:13:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:13:09 user nova-compute[82184]: INFO nova.virt.block_device [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Booting with volume f0dc4ffd-98fa-4a8c-8843-73706a802dc5 at /dev/vda
Apr 12 02:13:09 user nova-compute[82184]: DEBUG nova.policy [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d5d81fffb14b1cab84b6160ceb7dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd685278576490480a97cd2bc5e048b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG os_brick.utils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7602236e-3ffe-420e-8fce-3d558ee23e4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6876b75-df81-4b1e-af45-2c2cd8d016a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1700ece-414c-4f2e-ad77-eadc9a00e721]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[de250ea2-7b3b-4ddc-8f13-6dd6be01e081]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:13:09 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:13:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf7e88d-dfea-4101-bc1f-5229413cdd3d]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG os_brick.utils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Updating existing volume attachment record: 0117818f-a9d5-4ec2-9c3a-a6d33f44eb2a {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:13:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Successfully created port: f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:13:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Successfully updated port: f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:13:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:13:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquired lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:13:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:13:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-6a9c45d6-9442-4ebd-a60b-6a9e47bc184a req-cbc1f9f5-2c32-46fe-b401-7af61610a6e1 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received event network-changed-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:13:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-6a9c45d6-9442-4ebd-a60b-6a9e47bc184a req-cbc1f9f5-2c32-46fe-b401-7af61610a6e1 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Refreshing instance network info cache due to event network-changed-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:13:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6a9c45d6-9442-4ebd-a60b-6a9e47bc184a req-cbc1f9f5-2c32-46fe-b401-7af61610a6e1 service nova] Acquiring lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:13:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:13:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Updating instance_info_cache with network_info: [{"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:13:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Releasing lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:13:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Instance network_info: |[{"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:13:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6a9c45d6-9442-4ebd-a60b-6a9e47bc184a req-cbc1f9f5-2c32-46fe-b401-7af61610a6e1 service nova] Acquired lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:13:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-6a9c45d6-9442-4ebd-a60b-6a9e47bc184a req-cbc1f9f5-2c32-46fe-b401-7af61610a6e1 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Refreshing network info cache for port f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:13:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:13:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-6a9c45d6-9442-4ebd-a60b-6a9e47bc184a req-cbc1f9f5-2c32-46fe-b401-7af61610a6e1 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Updated VIF entry in instance network info cache for port f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:13:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-6a9c45d6-9442-4ebd-a60b-6a9e47bc184a req-cbc1f9f5-2c32-46fe-b401-7af61610a6e1 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Updating instance_info_cache with network_info: [{"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:13:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6a9c45d6-9442-4ebd-a60b-6a9e47bc184a req-cbc1f9f5-2c32-46fe-b401-7af61610a6e1 service nova] Releasing lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:13:13 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Creating image(s)
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Ensure instance console log exists: /opt/stack/data/nova/instances/fc88ac73-1963-4055-bd73-7a51c0850528/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Start _get_guest_xml network_info=[{"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '0117818f-a9d5-4ec2-9c3a-a6d33f44eb2a', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUiuEkPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc88ac73-1963-4055-bd73-7a51c0850528', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 'serial': 'f0dc4ffd-98fa-4a8c-8843-73706a802dc5'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:13:13 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:13:13 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUiuEkPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:13:13 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:13:13 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:13:13 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ee049a-a2fc-42f0-82e6-cecd1a7a98b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:13:13 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d2acdc-9f95-4c24-8d02-a57a1cb5d59c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5] added
Apr 12 02:13:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c6c279-351d-4759-9cbc-c65caa3fafe0]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a020126-6629-411f-868b-fa6e81d81f59]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUiuEkPH {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUiuEkPH" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b03f7d6-8ff7-4b74-b076-8b3259da1d82]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUiuEkPH'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef80718-7476-44fa-8561-88ee76ed5049]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fea73b6-513b-4a0f-9d72-21898becac30]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 02:13:13 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 02:13:13 user nova-compute[82184]:  {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:13:13 user nova-compute[82184]: WARNING os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 02:13:13 user nova-compute[82184]: 
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8970bcaa-24d0-4c6b-8c8f-d7e600a8843d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260]
Apr 12 02:13:13 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260] successful.
Apr 12 02:13:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e113561b-e6c6-4d38-84a4-de3ef89fc29c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a2e952-27f4-4e11-ab02-7897c5169681]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:13:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:13:13 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cf55ae-0b8a-49d3-9474-4aa5d98de90d]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:13:13 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:13:14 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:13:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUiuEkPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:13:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:13:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26630363432636565', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:13:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630363432636565', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:13:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1377116913',display_name='tempest-TestVolumeBootPattern-server-1377116913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1377116913',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZLzl+dJPPiQ1Q3KddtYvgtfp4Cw3N4yjPTn4jGAIGgcnNkNcoYvsYhuJ1X9VE6SsNAdPUgVuioRnH9/wkBTudNIYOOGxrInu47Q267Lh/dzVGncnNeYWswwovQJnMLew==',key_name='tempest-TestVolumeBootPattern-1281564430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-u0afcgph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:13:09Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=fc88ac73-1963-4055-bd73-7a51c0850528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:13:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:13:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:9f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c96f05-2c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:13:14 user nova-compute[82184]: DEBUG nova.objects.instance [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'pci_devices' on Instance uuid fc88ac73-1963-4055-bd73-7a51c0850528 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:13:15 user nova-compute[82184]:   <uuid>fc88ac73-1963-4055-bd73-7a51c0850528</uuid>
Apr 12 02:13:15 user nova-compute[82184]:   <name>instance-00000023</name>
Apr 12 02:13:15 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:13:15 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:13:15 user nova-compute[82184]:   <metadata>
Apr 12 02:13:15 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:13:15 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:13:15 user nova-compute[82184]:       <nova:name>tempest-TestVolumeBootPattern-server-1377116913</nova:name>
Apr 12 02:13:15 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:13:13</nova:creationTime>
Apr 12 02:13:15 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:13:15 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:13:15 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:13:15 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:13:15 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:13:15 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:13:15 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:13:15 user nova-compute[82184]:       <nova:owner>
Apr 12 02:13:15 user nova-compute[82184]:         <nova:user uuid="69d5d81fffb14b1cab84b6160ceb7dd2">tempest-TestVolumeBootPattern-2043953815-project-member</nova:user>
Apr 12 02:13:15 user nova-compute[82184]:         <nova:project uuid="bcd685278576490480a97cd2bc5e048b">tempest-TestVolumeBootPattern-2043953815</nova:project>
Apr 12 02:13:15 user nova-compute[82184]:       </nova:owner>
Apr 12 02:13:15 user nova-compute[82184]:       <nova:ports>
Apr 12 02:13:15 user nova-compute[82184]:         <nova:port uuid="f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da">
Apr 12 02:13:15 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 02:13:15 user nova-compute[82184]:         </nova:port>
Apr 12 02:13:15 user nova-compute[82184]:       </nova:ports>
Apr 12 02:13:15 user nova-compute[82184]:     </nova:instance>
Apr 12 02:13:15 user nova-compute[82184]:   </metadata>
Apr 12 02:13:15 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:13:15 user nova-compute[82184]:     <system>
Apr 12 02:13:15 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:13:15 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:13:15 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:13:15 user nova-compute[82184]:       <entry name="serial">fc88ac73-1963-4055-bd73-7a51c0850528</entry>
Apr 12 02:13:15 user nova-compute[82184]:       <entry name="uuid">fc88ac73-1963-4055-bd73-7a51c0850528</entry>
Apr 12 02:13:15 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:13:15 user nova-compute[82184]:     </system>
Apr 12 02:13:15 user nova-compute[82184]:   </sysinfo>
Apr 12 02:13:15 user nova-compute[82184]:   <os>
Apr 12 02:13:15 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:13:15 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:13:15 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:13:15 user nova-compute[82184]:   </os>
Apr 12 02:13:15 user nova-compute[82184]:   <features>
Apr 12 02:13:15 user nova-compute[82184]:     <acpi/>
Apr 12 02:13:15 user nova-compute[82184]:     <apic/>
Apr 12 02:13:15 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:13:15 user nova-compute[82184]:   </features>
Apr 12 02:13:15 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:13:15 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:13:15 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:13:15 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:13:15 user nova-compute[82184]:   </clock>
Apr 12 02:13:15 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:13:15 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:13:15 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:13:15 user nova-compute[82184]:   </cpu>
Apr 12 02:13:15 user nova-compute[82184]:   <devices>
Apr 12 02:13:15 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:13:15 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:13:15 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 02:13:15 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:13:15 user nova-compute[82184]:       <serial>f0dc4ffd-98fa-4a8c-8843-73706a802dc5</serial>
Apr 12 02:13:15 user nova-compute[82184]:     </disk>
Apr 12 02:13:15 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:13:15 user nova-compute[82184]:       <mac address="fa:16:3e:14:9f:d5"/>
Apr 12 02:13:15 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:13:15 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:13:15 user nova-compute[82184]:       <target dev="tapf6c96f05-2c"/>
Apr 12 02:13:15 user nova-compute[82184]:     </interface>
Apr 12 02:13:15 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:13:15 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/fc88ac73-1963-4055-bd73-7a51c0850528/console.log" append="off"/>
Apr 12 02:13:15 user nova-compute[82184]:     </serial>
Apr 12 02:13:15 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:13:15 user nova-compute[82184]:     <video>
Apr 12 02:13:15 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:13:15 user nova-compute[82184]:     </video>
Apr 12 02:13:15 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:13:15 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:13:15 user nova-compute[82184]:     </rng>
Apr 12 02:13:15 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:13:15 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:13:15 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:13:15 user nova-compute[82184]:     </memballoon>
Apr 12 02:13:15 user nova-compute[82184]:   </devices>
Apr 12 02:13:15 user nova-compute[82184]: </domain>
Apr 12 02:13:15 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1377116913',display_name='tempest-TestVolumeBootPattern-server-1377116913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1377116913',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZLzl+dJPPiQ1Q3KddtYvgtfp4Cw3N4yjPTn4jGAIGgcnNkNcoYvsYhuJ1X9VE6SsNAdPUgVuioRnH9/wkBTudNIYOOGxrInu47Q267Lh/dzVGncnNeYWswwovQJnMLew==',key_name='tempest-TestVolumeBootPattern-1281564430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-u0afcgph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:13:09Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=fc88ac73-1963-4055-bd73-7a51c0850528,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:9f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c96f05-2c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG os_vif [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:9f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c96f05-2c') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6c96f05-2c, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6c96f05-2c, col_values=(('external_ids', {'iface-id': 'f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:9f:d5', 'vm-uuid': 'fc88ac73-1963-4055-bd73-7a51c0850528'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:15 user nova-compute[82184]: INFO os_vif [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:9f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c96f05-2c')
Apr 12 02:13:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:13:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No VIF found with MAC fa:16:3e:14:9f:d5, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-5ebe2827-e850-4f6b-8cd9-edde15aa6029 req-35ce2786-85a5-4668-adf9-cb1525357e96 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received event network-vif-plugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5ebe2827-e850-4f6b-8cd9-edde15aa6029 req-35ce2786-85a5-4668-adf9-cb1525357e96 service nova] Acquiring lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5ebe2827-e850-4f6b-8cd9-edde15aa6029 req-35ce2786-85a5-4668-adf9-cb1525357e96 service nova] Lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5ebe2827-e850-4f6b-8cd9-edde15aa6029 req-35ce2786-85a5-4668-adf9-cb1525357e96 service nova] Lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-5ebe2827-e850-4f6b-8cd9-edde15aa6029 req-35ce2786-85a5-4668-adf9-cb1525357e96 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] No waiting events found dispatching network-vif-plugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:13:16 user nova-compute[82184]: WARNING nova.compute.manager [req-5ebe2827-e850-4f6b-8cd9-edde15aa6029 req-35ce2786-85a5-4668-adf9-cb1525357e96 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received unexpected event network-vif-plugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da for instance with vm_state building and task_state spawning.
Apr 12 02:13:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265598.3535495, fc88ac73-1963-4055-bd73-7a51c0850528 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:13:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] VM Resumed (Lifecycle Event)
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:13:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Instance spawned successfully.
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:13:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265598.35528, fc88ac73-1963-4055-bd73-7a51c0850528 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:13:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] VM Started (Lifecycle Event)
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:13:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:13:18 user nova-compute[82184]: INFO nova.compute.manager [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Took 4.84 seconds to spawn the instance on the hypervisor.
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:13:18 user nova-compute[82184]: INFO nova.compute.manager [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Took 9.76 seconds to build instance.
Apr 12 02:13:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0810e3bb-281f-49b6-878e-3a6f91db97a4 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fc88ac73-1963-4055-bd73-7a51c0850528" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.861s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-0c05d185-1d09-409d-9b7b-51e768664083 req-a93c7422-7055-4c73-ae32-5ddc8df3069b service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received event network-vif-plugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0c05d185-1d09-409d-9b7b-51e768664083 req-a93c7422-7055-4c73-ae32-5ddc8df3069b service nova] Acquiring lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0c05d185-1d09-409d-9b7b-51e768664083 req-a93c7422-7055-4c73-ae32-5ddc8df3069b service nova] Lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0c05d185-1d09-409d-9b7b-51e768664083 req-a93c7422-7055-4c73-ae32-5ddc8df3069b service nova] Lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-0c05d185-1d09-409d-9b7b-51e768664083 req-a93c7422-7055-4c73-ae32-5ddc8df3069b service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] No waiting events found dispatching network-vif-plugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:13:18 user nova-compute[82184]: WARNING nova.compute.manager [req-0c05d185-1d09-409d-9b7b-51e768664083 req-a93c7422-7055-4c73-ae32-5ddc8df3069b service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received unexpected event network-vif-plugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da for instance with vm_state active and task_state None.
Apr 12 02:13:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "1a3c868f-3a4c-430e-8009-7a855e832f82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:29 user nova-compute[82184]: INFO nova.compute.manager [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Terminating instance
Apr 12 02:13:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:13:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-c0cdcbf5-c643-41fa-8cfa-f27018b51894 req-4fc107e5-4329-486d-a807-d0093e2d2ee0 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received event network-vif-unplugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c0cdcbf5-c643-41fa-8cfa-f27018b51894 req-4fc107e5-4329-486d-a807-d0093e2d2ee0 service nova] Acquiring lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c0cdcbf5-c643-41fa-8cfa-f27018b51894 req-4fc107e5-4329-486d-a807-d0093e2d2ee0 service nova] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c0cdcbf5-c643-41fa-8cfa-f27018b51894 req-4fc107e5-4329-486d-a807-d0093e2d2ee0 service nova] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-c0cdcbf5-c643-41fa-8cfa-f27018b51894 req-4fc107e5-4329-486d-a807-d0093e2d2ee0 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] No waiting events found dispatching network-vif-unplugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG nova.compute.manager [req-c0cdcbf5-c643-41fa-8cfa-f27018b51894 req-4fc107e5-4329-486d-a807-d0093e2d2ee0 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received event network-vif-unplugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:30 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Instance destroyed successfully.
Apr 12 02:13:30 user nova-compute[82184]: DEBUG nova.objects.instance [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lazy-loading 'resources' on Instance uuid 1a3c868f-3a4c-430e-8009-7a855e832f82 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-312717327',display_name='tempest-ServerActionsTestJSON-server-312717327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-312717327',id=28,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1sUn4ZyIzVWiCtOrmiSV/0bbq9mYMTAsy+xwTDk6JQuJ5RMkrEvjPYuyz4Zno9RvobzKj4DM8GWPUelp3zq8n5Xrf63oYfGsblJs4n7uxBlQIBcuWW0l1ExcediwSzPw==',key_name='tempest-keypair-1931079911',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='117589cba4a54dd581f4ec5c26b4cd2a',ramdisk_id='',reservation_id='r-b1jhexcc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1409832124',owner_user_name='tempest-ServerActionsTestJSON-1409832124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8e8b9f0307b4d3fb54d89962798026b',uuid=1a3c868f-3a4c-430e-8009-7a855e832f82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converting VIF {"id": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "address": "fa:16:3e:fe:33:b8", "network": {"id": "16f5655f-6169-43e9-9110-9fcbab7a3d5d", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-232752764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "117589cba4a54dd581f4ec5c26b4cd2a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap915517f3-52", "ovs_interfaceid": "915517f3-521b-4d3a-a7c0-841b64ac50a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=915517f3-521b-4d3a-a7c0-841b64ac50a8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap915517f3-52') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG os_vif [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=915517f3-521b-4d3a-a7c0-841b64ac50a8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap915517f3-52') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap915517f3-52, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:13:30 user nova-compute[82184]: INFO os_vif [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:33:b8,bridge_name='br-int',has_traffic_filtering=True,id=915517f3-521b-4d3a-a7c0-841b64ac50a8,network=Network(16f5655f-6169-43e9-9110-9fcbab7a3d5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap915517f3-52')
Apr 12 02:13:30 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Deleting instance files /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82_del
Apr 12 02:13:30 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Deletion of /opt/stack/data/nova/instances/1a3c868f-3a4c-430e-8009-7a855e832f82_del complete
Apr 12 02:13:30 user nova-compute[82184]: INFO nova.compute.manager [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 12 02:13:30 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:13:30 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:13:31 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:13:31 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Took 0.45 seconds to deallocate network for instance.
Apr 12 02:13:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:31 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:13:31 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:13:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:31 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Deleted allocations for instance 1a3c868f-3a4c-430e-8009-7a855e832f82
Apr 12 02:13:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d9691597-12d3-48ae-9280-7072e09c6ab0 tempest-ServerActionsTestJSON-1409832124 tempest-ServerActionsTestJSON-1409832124-project-member] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.784s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-32a2cf00-b3db-45be-8b15-17446e7f4efe req-e1e171d6-f4fd-422b-9449-2ae866008a65 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received event network-vif-plugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:13:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-32a2cf00-b3db-45be-8b15-17446e7f4efe req-e1e171d6-f4fd-422b-9449-2ae866008a65 service nova] Acquiring lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:13:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-32a2cf00-b3db-45be-8b15-17446e7f4efe req-e1e171d6-f4fd-422b-9449-2ae866008a65 service nova] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:13:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-32a2cf00-b3db-45be-8b15-17446e7f4efe req-e1e171d6-f4fd-422b-9449-2ae866008a65 service nova] Lock "1a3c868f-3a4c-430e-8009-7a855e832f82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:13:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-32a2cf00-b3db-45be-8b15-17446e7f4efe req-e1e171d6-f4fd-422b-9449-2ae866008a65 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] No waiting events found dispatching network-vif-plugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:13:32 user nova-compute[82184]: WARNING nova.compute.manager [req-32a2cf00-b3db-45be-8b15-17446e7f4efe req-e1e171d6-f4fd-422b-9449-2ae866008a65 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received unexpected event network-vif-plugged-915517f3-521b-4d3a-a7c0-841b64ac50a8 for instance with vm_state deleted and task_state None.
Apr 12 02:13:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-32a2cf00-b3db-45be-8b15-17446e7f4efe req-e1e171d6-f4fd-422b-9449-2ae866008a65 service nova] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Received event network-vif-deleted-915517f3-521b-4d3a-a7c0-841b64ac50a8 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:13:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:45 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265610.7200305, 1a3c868f-3a4c-430e-8009-7a855e832f82 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:13:45 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] VM Stopped (Lifecycle Event)
Apr 12 02:13:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b3397a10-8787-4db4-9bbc-b828020d14b8 None None] [instance: 1a3c868f-3a4c-430e-8009-7a855e832f82] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:13:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:13:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:13:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:13:59 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:13:59 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:14:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:14:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:14:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:01 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:14:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:14:02 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:14:02 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:14:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=26.48923110961914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:14:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fc88ac73-1963-4055-bd73-7a51c0850528 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:14:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:14:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:14:02 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:14:02 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:14:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:14:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid fc88ac73-1963-4055-bd73-7a51c0850528 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Updating instance_info_cache with network_info: [{"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:14:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:14:04 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:14:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:14:08 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:14:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:14:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:14:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:14:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:14:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:14:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:14:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:14:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:26 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:14:26 user nova-compute[82184]: INFO nova.compute.claims [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Claim successful on node user
Apr 12 02:14:27 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:14:27 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:14:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG nova.policy [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88570fbc28654337a032da5fa1f58814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b73a0cde174feeb85558cebb13d137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:14:27 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Creating image(s)
Apr 12 02:14:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "/opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "/opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "df0a6e7b56c610af6e1269e781d9618eeb6e699b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "df0a6e7b56c610af6e1269e781d9618eeb6e699b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b.part --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b.part --force-share --output=json" returned: 0 in 0.158s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG nova.virt.images [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] 844b59ea-88c3-4180-bac8-c8fed5694334 was qcow2, converting to raw {{(pid=82184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b.part /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b.converted {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Successfully created port: 2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b.part /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b.converted" returned: 0 in 0.194s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b.converted --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b.converted --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "df0a6e7b56c610af6e1269e781d9618eeb6e699b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.878s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b --force-share --output=json" returned: 0 in 0.127s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "df0a6e7b56c610af6e1269e781d9618eeb6e699b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "df0a6e7b56c610af6e1269e781d9618eeb6e699b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b,backing_fmt=raw /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b,backing_fmt=raw /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk 1073741824" returned: 0 in 0.049s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "df0a6e7b56c610af6e1269e781d9618eeb6e699b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Successfully updated port: 2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquired lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG nova.compute.manager [req-00278f3c-c35d-4faa-8f8b-a425696cc759 req-1ca04699-5503-4c60-99ed-76627e7361a7 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-changed-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG nova.compute.manager [req-00278f3c-c35d-4faa-8f8b-a425696cc759 req-1ca04699-5503-4c60-99ed-76627e7361a7 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Refreshing instance network info cache due to event network-changed-2ee24eda-3ac7-48c9-b117-91371281aa33. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-00278f3c-c35d-4faa-8f8b-a425696cc759 req-1ca04699-5503-4c60-99ed-76627e7361a7 service nova] Acquiring lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b --force-share --output=json" returned: 0 in 0.149s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:28 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Cannot resize image /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.objects.instance [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'migration_context' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Ensure instance console log exists: /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating instance_info_cache with network_info: [{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Releasing lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Instance network_info: |[{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-00278f3c-c35d-4faa-8f8b-a425696cc759 req-1ca04699-5503-4c60-99ed-76627e7361a7 service nova] Acquired lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.network.neutron [req-00278f3c-c35d-4faa-8f8b-a425696cc759 req-1ca04699-5503-4c60-99ed-76627e7361a7 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Refreshing network info cache for port 2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Start _get_guest_xml network_info=[{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T02:14:24Z,direct_url=<?>,disk_format='qcow2',id=844b59ea-88c3-4180-bac8-c8fed5694334,min_disk=0,min_ram=0,name='tempest-scenario-img--1164277561',owner='71b73a0cde174feeb85558cebb13d137',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T02:14:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '844b59ea-88c3-4180-bac8-c8fed5694334'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:14:29 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:14:29 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T02:14:24Z,direct_url=<?>,disk_format='qcow2',id=844b59ea-88c3-4180-bac8-c8fed5694334,min_disk=0,min_ram=0,name='tempest-scenario-img--1164277561',owner='71b73a0cde174feeb85558cebb13d137',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T02:14:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1897008155',display_name='tempest-TestMinimumBasicScenario-server-1897008155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1897008155',id=36,image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9jZCWKV6hxux1R3+C+7uefGfjpgPqW32T2YiNnkme9UOOl4uU3OGWAWXACSx7haDpHOtbD7cTM7r65siGiAgj09hq/+hBvt2qQXd3ZpwfsOyduBx4iSrwxw2ZDVRKj2g==',key_name='tempest-TestMinimumBasicScenario-1687627615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b73a0cde174feeb85558cebb13d137',ramdisk_id='',reservation_id='r-gyd5dlif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-934200257',owner_user_name='tempest-TestMinimumBasicScenario-934200257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:14:27Z,user_data=None,user_id='88570fbc28654337a032da5fa1f58814',uuid=e6f93d39-5be6-4223-9ac8-362ee29f9e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converting VIF {"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.objects.instance [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'pci_devices' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:14:29 user nova-compute[82184]:   <uuid>e6f93d39-5be6-4223-9ac8-362ee29f9e22</uuid>
Apr 12 02:14:29 user nova-compute[82184]:   <name>instance-00000024</name>
Apr 12 02:14:29 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:14:29 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:14:29 user nova-compute[82184]:   <metadata>
Apr 12 02:14:29 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:14:29 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:14:29 user nova-compute[82184]:       <nova:name>tempest-TestMinimumBasicScenario-server-1897008155</nova:name>
Apr 12 02:14:29 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:14:29</nova:creationTime>
Apr 12 02:14:29 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:14:29 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:14:29 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:14:29 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:14:29 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:14:29 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:14:29 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:14:29 user nova-compute[82184]:       <nova:owner>
Apr 12 02:14:29 user nova-compute[82184]:         <nova:user uuid="88570fbc28654337a032da5fa1f58814">tempest-TestMinimumBasicScenario-934200257-project-member</nova:user>
Apr 12 02:14:29 user nova-compute[82184]:         <nova:project uuid="71b73a0cde174feeb85558cebb13d137">tempest-TestMinimumBasicScenario-934200257</nova:project>
Apr 12 02:14:29 user nova-compute[82184]:       </nova:owner>
Apr 12 02:14:29 user nova-compute[82184]:       <nova:root type="image" uuid="844b59ea-88c3-4180-bac8-c8fed5694334"/>
Apr 12 02:14:29 user nova-compute[82184]:       <nova:ports>
Apr 12 02:14:29 user nova-compute[82184]:         <nova:port uuid="2ee24eda-3ac7-48c9-b117-91371281aa33">
Apr 12 02:14:29 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 02:14:29 user nova-compute[82184]:         </nova:port>
Apr 12 02:14:29 user nova-compute[82184]:       </nova:ports>
Apr 12 02:14:29 user nova-compute[82184]:     </nova:instance>
Apr 12 02:14:29 user nova-compute[82184]:   </metadata>
Apr 12 02:14:29 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:14:29 user nova-compute[82184]:     <system>
Apr 12 02:14:29 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:14:29 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:14:29 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:14:29 user nova-compute[82184]:       <entry name="serial">e6f93d39-5be6-4223-9ac8-362ee29f9e22</entry>
Apr 12 02:14:29 user nova-compute[82184]:       <entry name="uuid">e6f93d39-5be6-4223-9ac8-362ee29f9e22</entry>
Apr 12 02:14:29 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:14:29 user nova-compute[82184]:     </system>
Apr 12 02:14:29 user nova-compute[82184]:   </sysinfo>
Apr 12 02:14:29 user nova-compute[82184]:   <os>
Apr 12 02:14:29 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:14:29 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:14:29 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:14:29 user nova-compute[82184]:   </os>
Apr 12 02:14:29 user nova-compute[82184]:   <features>
Apr 12 02:14:29 user nova-compute[82184]:     <acpi/>
Apr 12 02:14:29 user nova-compute[82184]:     <apic/>
Apr 12 02:14:29 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:14:29 user nova-compute[82184]:   </features>
Apr 12 02:14:29 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:14:29 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:14:29 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:14:29 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:14:29 user nova-compute[82184]:   </clock>
Apr 12 02:14:29 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:14:29 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:14:29 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:14:29 user nova-compute[82184]:   </cpu>
Apr 12 02:14:29 user nova-compute[82184]:   <devices>
Apr 12 02:14:29 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:14:29 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:14:29 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk"/>
Apr 12 02:14:29 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:14:29 user nova-compute[82184]:     </disk>
Apr 12 02:14:29 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:14:29 user nova-compute[82184]:       <mac address="fa:16:3e:98:2c:6a"/>
Apr 12 02:14:29 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:14:29 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:14:29 user nova-compute[82184]:       <target dev="tap2ee24eda-3a"/>
Apr 12 02:14:29 user nova-compute[82184]:     </interface>
Apr 12 02:14:29 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:14:29 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/console.log" append="off"/>
Apr 12 02:14:29 user nova-compute[82184]:     </serial>
Apr 12 02:14:29 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:14:29 user nova-compute[82184]:     <video>
Apr 12 02:14:29 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:14:29 user nova-compute[82184]:     </video>
Apr 12 02:14:29 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:14:29 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:14:29 user nova-compute[82184]:     </rng>
Apr 12 02:14:29 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:14:29 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:14:29 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:14:29 user nova-compute[82184]:     </memballoon>
Apr 12 02:14:29 user nova-compute[82184]:   </devices>
Apr 12 02:14:29 user nova-compute[82184]: </domain>
Apr 12 02:14:29 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1897008155',display_name='tempest-TestMinimumBasicScenario-server-1897008155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1897008155',id=36,image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9jZCWKV6hxux1R3+C+7uefGfjpgPqW32T2YiNnkme9UOOl4uU3OGWAWXACSx7haDpHOtbD7cTM7r65siGiAgj09hq/+hBvt2qQXd3ZpwfsOyduBx4iSrwxw2ZDVRKj2g==',key_name='tempest-TestMinimumBasicScenario-1687627615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b73a0cde174feeb85558cebb13d137',ramdisk_id='',reservation_id='r-gyd5dlif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-934200257',owner_user_name='tempest-TestMinimumBasicScenario-934200257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:14:27Z,user_data=None,user_id='88570fbc28654337a032da5fa1f58814',uuid=e6f93d39-5be6-4223-9ac8-362ee29f9e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converting VIF {"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG os_vif [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ee24eda-3a, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ee24eda-3a, col_values=(('external_ids', {'iface-id': '2ee24eda-3ac7-48c9-b117-91371281aa33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:2c:6a', 'vm-uuid': 'e6f93d39-5be6-4223-9ac8-362ee29f9e22'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:29 user nova-compute[82184]: INFO os_vif [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a')
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] No VIF found with MAC fa:16:3e:98:2c:6a, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.network.neutron [req-00278f3c-c35d-4faa-8f8b-a425696cc759 req-1ca04699-5503-4c60-99ed-76627e7361a7 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updated VIF entry in instance network info cache for port 2ee24eda-3ac7-48c9-b117-91371281aa33. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG nova.network.neutron [req-00278f3c-c35d-4faa-8f8b-a425696cc759 req-1ca04699-5503-4c60-99ed-76627e7361a7 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating instance_info_cache with network_info: [{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:14:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-00278f3c-c35d-4faa-8f8b-a425696cc759 req-1ca04699-5503-4c60-99ed-76627e7361a7 service nova] Releasing lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:14:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-ef93f2a2-fa0f-4e19-9991-32100663950f req-dcf9f809-7500-4a34-b920-710f4c3ca1f5 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:14:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ef93f2a2-fa0f-4e19-9991-32100663950f req-dcf9f809-7500-4a34-b920-710f4c3ca1f5 service nova] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ef93f2a2-fa0f-4e19-9991-32100663950f req-dcf9f809-7500-4a34-b920-710f4c3ca1f5 service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ef93f2a2-fa0f-4e19-9991-32100663950f req-dcf9f809-7500-4a34-b920-710f4c3ca1f5 service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-ef93f2a2-fa0f-4e19-9991-32100663950f req-dcf9f809-7500-4a34-b920-710f4c3ca1f5 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] No waiting events found dispatching network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:14:31 user nova-compute[82184]: WARNING nova.compute.manager [req-ef93f2a2-fa0f-4e19-9991-32100663950f req-dcf9f809-7500-4a34-b920-710f4c3ca1f5 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received unexpected event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 for instance with vm_state building and task_state spawning.
Apr 12 02:14:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265673.0086064, e6f93d39-5be6-4223-9ac8-362ee29f9e22 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:14:33 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] VM Resumed (Lifecycle Event)
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:14:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Instance spawned successfully.
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:33 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265673.0126636, e6f93d39-5be6-4223-9ac8-362ee29f9e22 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:14:33 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] VM Started (Lifecycle Event)
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:14:33 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:14:33 user nova-compute[82184]: INFO nova.compute.manager [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Took 5.63 seconds to spawn the instance on the hypervisor.
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:14:33 user nova-compute[82184]: INFO nova.compute.manager [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Took 6.24 seconds to build instance.
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-630a040f-49ea-4c55-a723-db75935cf24e req-292fced9-9207-424f-9a2a-8e305a206319 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-630a040f-49ea-4c55-a723-db75935cf24e req-292fced9-9207-424f-9a2a-8e305a206319 service nova] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-630a040f-49ea-4c55-a723-db75935cf24e req-292fced9-9207-424f-9a2a-8e305a206319 service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-630a040f-49ea-4c55-a723-db75935cf24e req-292fced9-9207-424f-9a2a-8e305a206319 service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-630a040f-49ea-4c55-a723-db75935cf24e req-292fced9-9207-424f-9a2a-8e305a206319 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] No waiting events found dispatching network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:14:33 user nova-compute[82184]: WARNING nova.compute.manager [req-630a040f-49ea-4c55-a723-db75935cf24e req-292fced9-9207-424f-9a2a-8e305a206319 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received unexpected event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 for instance with vm_state active and task_state None.
Apr 12 02:14:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf4cd32b-7305-4d75-b521-0fe3c514503b tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.346s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:14:40 user nova-compute[82184]: INFO nova.compute.claims [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Claim successful on node user
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.network.neutron [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:14:40 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.policy [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe9217f4c1ff428086140b7fd07194eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb951049b464316a04647ce9c52963a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:14:40 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Creating image(s)
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "/opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "/opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "/opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk 1073741824" returned: 0 in 0.057s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.network.neutron [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Successfully created port: 162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Cannot resize image /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.objects.instance [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'migration_context' on Instance uuid 3036c0b5-7987-4ff5-9edf-ee7397cf7beb {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Ensure instance console log exists: /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.network.neutron [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Successfully updated port: 162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquired lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.network.neutron [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-6142f0fb-bc53-45dd-b397-01abbbf1fd8b req-823b78ea-bce9-4950-986c-5d07a1e8f3b6 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received event network-changed-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-6142f0fb-bc53-45dd-b397-01abbbf1fd8b req-823b78ea-bce9-4950-986c-5d07a1e8f3b6 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Refreshing instance network info cache due to event network-changed-162c49eb-7ebe-4a3d-aac4-10060fde3edf. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6142f0fb-bc53-45dd-b397-01abbbf1fd8b req-823b78ea-bce9-4950-986c-5d07a1e8f3b6 service nova] Acquiring lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:14:41 user nova-compute[82184]: DEBUG nova.network.neutron [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.network.neutron [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updating instance_info_cache with network_info: [{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Releasing lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Instance network_info: |[{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6142f0fb-bc53-45dd-b397-01abbbf1fd8b req-823b78ea-bce9-4950-986c-5d07a1e8f3b6 service nova] Acquired lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.network.neutron [req-6142f0fb-bc53-45dd-b397-01abbbf1fd8b req-823b78ea-bce9-4950-986c-5d07a1e8f3b6 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Refreshing network info cache for port 162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Start _get_guest_xml network_info=[{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:14:42 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:14:42 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1938777543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1938777543',id=37,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-8gl97olv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:14:41Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=3036c0b5-7987-4ff5-9edf-ee7397cf7beb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:62:12,bridge_name='br-int',has_traffic_filtering=True,id=162c49eb-7ebe-4a3d-aac4-10060fde3edf,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c49eb-7e') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.objects.instance [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'pci_devices' on Instance uuid 3036c0b5-7987-4ff5-9edf-ee7397cf7beb {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:14:42 user nova-compute[82184]:   <uuid>3036c0b5-7987-4ff5-9edf-ee7397cf7beb</uuid>
Apr 12 02:14:42 user nova-compute[82184]:   <name>instance-00000025</name>
Apr 12 02:14:42 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:14:42 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:14:42 user nova-compute[82184]:   <metadata>
Apr 12 02:14:42 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:14:42 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:14:42 user nova-compute[82184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1938777543</nova:name>
Apr 12 02:14:42 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:14:42</nova:creationTime>
Apr 12 02:14:42 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:14:42 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:14:42 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:14:42 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:14:42 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:14:42 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:14:42 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:14:42 user nova-compute[82184]:       <nova:owner>
Apr 12 02:14:42 user nova-compute[82184]:         <nova:user uuid="fe9217f4c1ff428086140b7fd07194eb">tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member</nova:user>
Apr 12 02:14:42 user nova-compute[82184]:         <nova:project uuid="6bb951049b464316a04647ce9c52963a">tempest-ServerBootFromVolumeStableRescueTest-1070279577</nova:project>
Apr 12 02:14:42 user nova-compute[82184]:       </nova:owner>
Apr 12 02:14:42 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:14:42 user nova-compute[82184]:       <nova:ports>
Apr 12 02:14:42 user nova-compute[82184]:         <nova:port uuid="162c49eb-7ebe-4a3d-aac4-10060fde3edf">
Apr 12 02:14:42 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 02:14:42 user nova-compute[82184]:         </nova:port>
Apr 12 02:14:42 user nova-compute[82184]:       </nova:ports>
Apr 12 02:14:42 user nova-compute[82184]:     </nova:instance>
Apr 12 02:14:42 user nova-compute[82184]:   </metadata>
Apr 12 02:14:42 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:14:42 user nova-compute[82184]:     <system>
Apr 12 02:14:42 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:14:42 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:14:42 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:14:42 user nova-compute[82184]:       <entry name="serial">3036c0b5-7987-4ff5-9edf-ee7397cf7beb</entry>
Apr 12 02:14:42 user nova-compute[82184]:       <entry name="uuid">3036c0b5-7987-4ff5-9edf-ee7397cf7beb</entry>
Apr 12 02:14:42 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:14:42 user nova-compute[82184]:     </system>
Apr 12 02:14:42 user nova-compute[82184]:   </sysinfo>
Apr 12 02:14:42 user nova-compute[82184]:   <os>
Apr 12 02:14:42 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:14:42 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:14:42 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:14:42 user nova-compute[82184]:   </os>
Apr 12 02:14:42 user nova-compute[82184]:   <features>
Apr 12 02:14:42 user nova-compute[82184]:     <acpi/>
Apr 12 02:14:42 user nova-compute[82184]:     <apic/>
Apr 12 02:14:42 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:14:42 user nova-compute[82184]:   </features>
Apr 12 02:14:42 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:14:42 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:14:42 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:14:42 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:14:42 user nova-compute[82184]:   </clock>
Apr 12 02:14:42 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:14:42 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:14:42 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:14:42 user nova-compute[82184]:   </cpu>
Apr 12 02:14:42 user nova-compute[82184]:   <devices>
Apr 12 02:14:42 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:14:42 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:14:42 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk"/>
Apr 12 02:14:42 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:14:42 user nova-compute[82184]:     </disk>
Apr 12 02:14:42 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:14:42 user nova-compute[82184]:       <mac address="fa:16:3e:6d:62:12"/>
Apr 12 02:14:42 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:14:42 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:14:42 user nova-compute[82184]:       <target dev="tap162c49eb-7e"/>
Apr 12 02:14:42 user nova-compute[82184]:     </interface>
Apr 12 02:14:42 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:14:42 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/console.log" append="off"/>
Apr 12 02:14:42 user nova-compute[82184]:     </serial>
Apr 12 02:14:42 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:14:42 user nova-compute[82184]:     <video>
Apr 12 02:14:42 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:14:42 user nova-compute[82184]:     </video>
Apr 12 02:14:42 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:14:42 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:14:42 user nova-compute[82184]:     </rng>
Apr 12 02:14:42 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:14:42 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:14:42 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:14:42 user nova-compute[82184]:     </memballoon>
Apr 12 02:14:42 user nova-compute[82184]:   </devices>
Apr 12 02:14:42 user nova-compute[82184]: </domain>
Apr 12 02:14:42 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1938777543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1938777543',id=37,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-8gl97olv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:14:41Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=3036c0b5-7987-4ff5-9edf-ee7397cf7beb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:62:12,bridge_name='br-int',has_traffic_filtering=True,id=162c49eb-7ebe-4a3d-aac4-10060fde3edf,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c49eb-7e') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG os_vif [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:62:12,bridge_name='br-int',has_traffic_filtering=True,id=162c49eb-7ebe-4a3d-aac4-10060fde3edf,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c49eb-7e') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap162c49eb-7e, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap162c49eb-7e, col_values=(('external_ids', {'iface-id': '162c49eb-7ebe-4a3d-aac4-10060fde3edf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:62:12', 'vm-uuid': '3036c0b5-7987-4ff5-9edf-ee7397cf7beb'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:42 user nova-compute[82184]: INFO os_vif [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:62:12,bridge_name='br-int',has_traffic_filtering=True,id=162c49eb-7ebe-4a3d-aac4-10060fde3edf,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c49eb-7e')
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No VIF found with MAC fa:16:3e:6d:62:12, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.network.neutron [req-6142f0fb-bc53-45dd-b397-01abbbf1fd8b req-823b78ea-bce9-4950-986c-5d07a1e8f3b6 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updated VIF entry in instance network info cache for port 162c49eb-7ebe-4a3d-aac4-10060fde3edf. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG nova.network.neutron [req-6142f0fb-bc53-45dd-b397-01abbbf1fd8b req-823b78ea-bce9-4950-986c-5d07a1e8f3b6 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updating instance_info_cache with network_info: [{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:14:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-6142f0fb-bc53-45dd-b397-01abbbf1fd8b req-823b78ea-bce9-4950-986c-5d07a1e8f3b6 service nova] Releasing lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:14:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-fb07fa07-951c-4c99-b35e-bc795087788e req-53f81984-98dd-4420-a7b0-e26603923eed service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:14:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fb07fa07-951c-4c99-b35e-bc795087788e req-53f81984-98dd-4420-a7b0-e26603923eed service nova] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fb07fa07-951c-4c99-b35e-bc795087788e req-53f81984-98dd-4420-a7b0-e26603923eed service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fb07fa07-951c-4c99-b35e-bc795087788e req-53f81984-98dd-4420-a7b0-e26603923eed service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-fb07fa07-951c-4c99-b35e-bc795087788e req-53f81984-98dd-4420-a7b0-e26603923eed service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] No waiting events found dispatching network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:14:43 user nova-compute[82184]: WARNING nova.compute.manager [req-fb07fa07-951c-4c99-b35e-bc795087788e req-53f81984-98dd-4420-a7b0-e26603923eed service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received unexpected event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf for instance with vm_state building and task_state spawning.
Apr 12 02:14:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265685.901779, 3036c0b5-7987-4ff5-9edf-ee7397cf7beb => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:14:45 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] VM Resumed (Lifecycle Event)
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:14:45 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Instance spawned successfully.
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:14:45 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265685.903162, 3036c0b5-7987-4ff5-9edf-ee7397cf7beb => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:14:45 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] VM Started (Lifecycle Event)
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:14:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:14:46 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:14:46 user nova-compute[82184]: INFO nova.compute.manager [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Took 5.35 seconds to spawn the instance on the hypervisor.
Apr 12 02:14:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:14:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-f1636ee9-0280-4f91-b965-d91f83953457 req-36afe8d0-3198-405f-a95d-bed963ee11be service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:14:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f1636ee9-0280-4f91-b965-d91f83953457 req-36afe8d0-3198-405f-a95d-bed963ee11be service nova] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:14:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f1636ee9-0280-4f91-b965-d91f83953457 req-36afe8d0-3198-405f-a95d-bed963ee11be service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:14:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f1636ee9-0280-4f91-b965-d91f83953457 req-36afe8d0-3198-405f-a95d-bed963ee11be service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-f1636ee9-0280-4f91-b965-d91f83953457 req-36afe8d0-3198-405f-a95d-bed963ee11be service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] No waiting events found dispatching network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:14:46 user nova-compute[82184]: WARNING nova.compute.manager [req-f1636ee9-0280-4f91-b965-d91f83953457 req-36afe8d0-3198-405f-a95d-bed963ee11be service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received unexpected event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf for instance with vm_state building and task_state spawning.
Apr 12 02:14:46 user nova-compute[82184]: INFO nova.compute.manager [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Took 5.99 seconds to build instance.
Apr 12 02:14:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-069e3409-5e8e-4052-949a-2f423841c485 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.091s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:14:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:14:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:14:59 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-a6973f67-0c94-4859-b48e-fa84802ecf43 req-02673cc6-4e55-4f87-afb7-759a4652ccda service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received event network-changed-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-a6973f67-0c94-4859-b48e-fa84802ecf43 req-02673cc6-4e55-4f87-afb7-759a4652ccda service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Refreshing instance network info cache due to event network-changed-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a6973f67-0c94-4859-b48e-fa84802ecf43 req-02673cc6-4e55-4f87-afb7-759a4652ccda service nova] Acquiring lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a6973f67-0c94-4859-b48e-fa84802ecf43 req-02673cc6-4e55-4f87-afb7-759a4652ccda service nova] Acquired lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-a6973f67-0c94-4859-b48e-fa84802ecf43 req-02673cc6-4e55-4f87-afb7-759a4652ccda service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Refreshing network info cache for port f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "fc88ac73-1963-4055-bd73-7a51c0850528" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fc88ac73-1963-4055-bd73-7a51c0850528" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:15:00 user nova-compute[82184]: INFO nova.compute.manager [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Terminating instance
Apr 12 02:15:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-a6973f67-0c94-4859-b48e-fa84802ecf43 req-02673cc6-4e55-4f87-afb7-759a4652ccda service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Updated VIF entry in instance network info cache for port f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG nova.network.neutron [req-a6973f67-0c94-4859-b48e-fa84802ecf43 req-02673cc6-4e55-4f87-afb7-759a4652ccda service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Updating instance_info_cache with network_info: [{"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:15:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a6973f67-0c94-4859-b48e-fa84802ecf43 req-02673cc6-4e55-4f87-afb7-759a4652ccda service nova] Releasing lock "refresh_cache-fc88ac73-1963-4055-bd73-7a51c0850528" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-59ee3773-086c-49ea-ac1b-08002ec4bd9c req-34f4dd2a-e689-4ef3-b057-5e2be8a2129f service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received event network-vif-unplugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-59ee3773-086c-49ea-ac1b-08002ec4bd9c req-34f4dd2a-e689-4ef3-b057-5e2be8a2129f service nova] Acquiring lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-59ee3773-086c-49ea-ac1b-08002ec4bd9c req-34f4dd2a-e689-4ef3-b057-5e2be8a2129f service nova] Lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-59ee3773-086c-49ea-ac1b-08002ec4bd9c req-34f4dd2a-e689-4ef3-b057-5e2be8a2129f service nova] Lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-59ee3773-086c-49ea-ac1b-08002ec4bd9c req-34f4dd2a-e689-4ef3-b057-5e2be8a2129f service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] No waiting events found dispatching network-vif-unplugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-59ee3773-086c-49ea-ac1b-08002ec4bd9c req-34f4dd2a-e689-4ef3-b057-5e2be8a2129f service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received event network-vif-unplugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:15:01 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Instance destroyed successfully.
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.objects.instance [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'resources' on Instance uuid fc88ac73-1963-4055-bd73-7a51c0850528 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1377116913',display_name='tempest-TestVolumeBootPattern-server-1377116913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1377116913',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZLzl+dJPPiQ1Q3KddtYvgtfp4Cw3N4yjPTn4jGAIGgcnNkNcoYvsYhuJ1X9VE6SsNAdPUgVuioRnH9/wkBTudNIYOOGxrInu47Q267Lh/dzVGncnNeYWswwovQJnMLew==',key_name='tempest-TestVolumeBootPattern-1281564430',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:13:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-u0afcgph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:13:19Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=fc88ac73-1963-4055-bd73-7a51c0850528,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "address": "fa:16:3e:14:9f:d5", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6c96f05-2c", "ovs_interfaceid": "f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:9f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c96f05-2c') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_vif [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:9f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c96f05-2c') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6c96f05-2c, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:15:01 user nova-compute[82184]: INFO os_vif [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:9f:d5,bridge_name='br-int',has_traffic_filtering=True,id=f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6c96f05-2c')
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUiuEkPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:15:01 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0c7dbf-349e-487f-b09f-120a2c8c72c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:15:01 user nova-compute[82184]: No targets found.
Apr 12 02:15:01 user nova-compute[82184]: iSNS:
Apr 12 02:15:01 user nova-compute[82184]: No targets found.
Apr 12 02:15:01 user nova-compute[82184]: STATIC:
Apr 12 02:15:01 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5
Apr 12 02:15:01 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:15:01 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:15:01 user nova-compute[82184]: FIRMWARE:
Apr 12 02:15:01 user nova-compute[82184]: No targets found.
Apr 12 02:15:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:15:01 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:15:01 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a9cca9-c79a-4b1d-a96b-4df81fe0de35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea5e344-346d-416a-a1d4-ff85d0f3c86b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:15:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:15:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a85ccd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a40887-f12b-4a85-b27f-26ea49500924]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8e18b1-799a-4a79-b312-3b7e7b938e45]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b832aad2-561a-4c0e-9731-da977ca3d951]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4129ba-296e-4830-aeb8-72306fa0a457]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8dfddebe', '/dev/disk/by-id/scsi-1SCST_BIO8dfddebe-f0642ceeb574dd09', '/dev/disk/by-id/scsi-26630363432636565') {{(pid=92498) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90e5308-bacb-4168-95fd-5483f6f512b0]: (4, None) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebcb026-5ab8-47b5-8dff-91461aa74f3e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa44e5a6-f18c-4b75-88a2-3855069ca7cd]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260]
Apr 12 02:15:01 user nova-compute[82184]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260] successful.
Apr 12 02:15:01 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa45fd48-963a-4f5b-8f78-640c899ae2fc]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== disconnect_volume: return (302ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:15:01 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Deleting instance files /opt/stack/data/nova/instances/fc88ac73-1963-4055-bd73-7a51c0850528_del
Apr 12 02:15:01 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Deletion of /opt/stack/data/nova/instances/fc88ac73-1963-4055-bd73-7a51c0850528_del complete
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:01 user nova-compute[82184]: INFO nova.compute.manager [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 12 02:15:01 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:15:01 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-9af60cbf-bed8-40f0-a7e3-25ab5b27e543 req-ce1c1832-b0b3-4e02-87a6-3ef661b62f23 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received event network-vif-deleted-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:15:02 user nova-compute[82184]: INFO nova.compute.manager [req-9af60cbf-bed8-40f0-a7e3-25ab5b27e543 req-ce1c1832-b0b3-4e02-87a6-3ef661b62f23 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Neutron deleted interface f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da; detaching it from the instance and deleting it from the info cache
Apr 12 02:15:02 user nova-compute[82184]: DEBUG nova.network.neutron [req-9af60cbf-bed8-40f0-a7e3-25ab5b27e543 req-ce1c1832-b0b3-4e02-87a6-3ef661b62f23 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:15:02 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:15:02 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:15:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8522MB free_disk=26.39862060546875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-9af60cbf-bed8-40f0-a7e3-25ab5b27e543 req-ce1c1832-b0b3-4e02-87a6-3ef661b62f23 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Detach interface failed, port_id=f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da, reason: Instance fc88ac73-1963-4055-bd73-7a51c0850528 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 02:15:02 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Took 0.89 seconds to deallocate network for instance.
Apr 12 02:15:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance fc88ac73-1963-4055-bd73-7a51c0850528 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e6f93d39-5be6-4223-9ac8-362ee29f9e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:15:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-4ab4bc15-11ce-485b-abac-b394859f3faf req-a9ed227a-b49e-4658-9ac7-99bb3db189b5 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received event network-vif-plugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4ab4bc15-11ce-485b-abac-b394859f3faf req-a9ed227a-b49e-4658-9ac7-99bb3db189b5 service nova] Acquiring lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4ab4bc15-11ce-485b-abac-b394859f3faf req-a9ed227a-b49e-4658-9ac7-99bb3db189b5 service nova] Lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4ab4bc15-11ce-485b-abac-b394859f3faf req-a9ed227a-b49e-4658-9ac7-99bb3db189b5 service nova] Lock "fc88ac73-1963-4055-bd73-7a51c0850528-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-4ab4bc15-11ce-485b-abac-b394859f3faf req-a9ed227a-b49e-4658-9ac7-99bb3db189b5 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] No waiting events found dispatching network-vif-plugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:15:03 user nova-compute[82184]: WARNING nova.compute.manager [req-4ab4bc15-11ce-485b-abac-b394859f3faf req-a9ed227a-b49e-4658-9ac7-99bb3db189b5 service nova] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Received unexpected event network-vif-plugged-f6c96f05-2c3b-4ac9-aaea-efa1c67ab2da for instance with vm_state active and task_state deleting.
Apr 12 02:15:03 user nova-compute[82184]: INFO nova.compute.manager [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Took 0.77 seconds to detach 1 volumes for instance.
Apr 12 02:15:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:15:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:15:03 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Deleted allocations for instance fc88ac73-1963-4055-bd73-7a51c0850528
Apr 12 02:15:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0354072d-6fa3-4438-9487-cf2a302459c1 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "fc88ac73-1963-4055-bd73-7a51c0850528" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.219s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating instance_info_cache with network_info: [{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:15:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:15:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:15:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:15:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:16 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265701.515524, fc88ac73-1963-4055-bd73-7a51c0850528 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:15:16 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] VM Stopped (Lifecycle Event)
Apr 12 02:15:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-9c95c5f0-b7e2-4f0a-ac27-60542d8a4b86 None None] [instance: fc88ac73-1963-4055-bd73-7a51c0850528] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:15:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:15:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:15:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:15:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:15:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:15:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:15:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:15:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:15:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:15:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "8553081b-42a3-45c9-a6f6-248315547366" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "8553081b-42a3-45c9-a6f6-248315547366" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:15:52 user nova-compute[82184]: INFO nova.compute.claims [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Claim successful on node user
Apr 12 02:15:52 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:15:52 user nova-compute[82184]: DEBUG nova.network.neutron [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:15:53 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:15:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:15:53 user nova-compute[82184]: INFO nova.virt.block_device [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Booting with volume f0dc4ffd-98fa-4a8c-8843-73706a802dc5 at /dev/vda
Apr 12 02:15:53 user nova-compute[82184]: DEBUG nova.policy [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d5d81fffb14b1cab84b6160ceb7dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd685278576490480a97cd2bc5e048b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG os_brick.utils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89eab19-99a4-4ebd-adf8-1ace6f19efef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c14f96-363e-4b17-82bc-370441a398f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[314b3dcc-2b2d-4a55-9dd3-41cf9607e080]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4590cb9-6d94-498c-86dd-3cde56a7058f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:15:53 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:15:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edc8943-e23f-4528-83e7-09e75867cdbe]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG os_brick.utils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updating existing volume attachment record: 315f16c5-60b5-43fd-aaaa-7eb387d91d34 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:53 user nova-compute[82184]: DEBUG nova.network.neutron [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Successfully created port: f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Successfully updated port: f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquired lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-10d401fa-3bf8-4d13-a0ef-33168ba2833e req-8dc666c0-6cae-4e0c-be3c-0c2c980a02da service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received event network-changed-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG nova.compute.manager [req-10d401fa-3bf8-4d13-a0ef-33168ba2833e req-8dc666c0-6cae-4e0c-be3c-0c2c980a02da service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Refreshing instance network info cache due to event network-changed-f3bfac63-9965-4cc9-9c67-91d735cdcc43. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-10d401fa-3bf8-4d13-a0ef-33168ba2833e req-8dc666c0-6cae-4e0c-be3c-0c2c980a02da service nova] Acquiring lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updating instance_info_cache with network_info: [{"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Releasing lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:15:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Instance network_info: |[{"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:15:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-10d401fa-3bf8-4d13-a0ef-33168ba2833e req-8dc666c0-6cae-4e0c-be3c-0c2c980a02da service nova] Acquired lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:15:55 user nova-compute[82184]: DEBUG nova.network.neutron [req-10d401fa-3bf8-4d13-a0ef-33168ba2833e req-8dc666c0-6cae-4e0c-be3c-0c2c980a02da service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Refreshing network info cache for port f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:15:55 user nova-compute[82184]: DEBUG nova.network.neutron [req-10d401fa-3bf8-4d13-a0ef-33168ba2833e req-8dc666c0-6cae-4e0c-be3c-0c2c980a02da service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updated VIF entry in instance network info cache for port f3bfac63-9965-4cc9-9c67-91d735cdcc43. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:15:55 user nova-compute[82184]: DEBUG nova.network.neutron [req-10d401fa-3bf8-4d13-a0ef-33168ba2833e req-8dc666c0-6cae-4e0c-be3c-0c2c980a02da service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updating instance_info_cache with network_info: [{"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:15:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-10d401fa-3bf8-4d13-a0ef-33168ba2833e req-8dc666c0-6cae-4e0c-be3c-0c2c980a02da service nova] Releasing lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:15:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:15:57 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Creating image(s)
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Ensure instance console log exists: /opt/stack/data/nova/instances/8553081b-42a3-45c9-a6f6-248315547366/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Start _get_guest_xml network_info=[{"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '315f16c5-60b5-43fd-aaaa-7eb387d91d34', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUiuEkPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8553081b-42a3-45c9-a6f6-248315547366', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 'serial': 'f0dc4ffd-98fa-4a8c-8843-73706a802dc5'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:15:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:15:57 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUiuEkPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:15:57 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:15:57 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:15:57 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe26af47-d88a-40ab-af1f-9ca7960b1fce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:15:57 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7dfb03-4dc3-445b-9a5a-b1b9673a2870]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5] added
Apr 12 02:15:57 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f24b39b-8ddf-4915-ab89-204d2f4c6bb8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a4a7f3-f02c-46b7-96d9-822f30c89cca]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUiuEkPH {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUiuEkPH" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[404744f8-6786-4d45-90e4-a2a3bc116deb]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUiuEkPH'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a98095-50fd-4127-a3a7-5a626e8979f5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba09e9d7-5842-4250-9c1e-69d987a5d22c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 02:15:57 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 02:15:57 user nova-compute[82184]:  {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:15:57 user nova-compute[82184]: WARNING os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 02:15:57 user nova-compute[82184]: 
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[94128b7a-e700-40bc-b5d6-bc07a0d86a31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260]
Apr 12 02:15:57 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260] successful.
Apr 12 02:15:57 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:57 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ecab9d-2c57-48cf-8752-04d6875d423f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c22bf5-d8ab-4643-8e98-537b5c6d359d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:15:58 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:15:58 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc41b5c1-5c9f-42f9-b4c1-fa90211a727a]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUiuEkPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:15:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26630363432636565', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630363432636565', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1500776453',display_name='tempest-TestVolumeBootPattern-server-1500776453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1500776453',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZLzl+dJPPiQ1Q3KddtYvgtfp4Cw3N4yjPTn4jGAIGgcnNkNcoYvsYhuJ1X9VE6SsNAdPUgVuioRnH9/wkBTudNIYOOGxrInu47Q267Lh/dzVGncnNeYWswwovQJnMLew==',key_name='tempest-TestVolumeBootPattern-1281564430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-o9elig80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:15:53Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=8553081b-42a3-45c9-a6f6-248315547366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:0c:79,bridge_name='br-int',has_traffic_filtering=True,id=f3bfac63-9965-4cc9-9c67-91d735cdcc43,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bfac63-99') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.objects.instance [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'pci_devices' on Instance uuid 8553081b-42a3-45c9-a6f6-248315547366 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:15:59 user nova-compute[82184]:   <uuid>8553081b-42a3-45c9-a6f6-248315547366</uuid>
Apr 12 02:15:59 user nova-compute[82184]:   <name>instance-00000026</name>
Apr 12 02:15:59 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:15:59 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:15:59 user nova-compute[82184]:   <metadata>
Apr 12 02:15:59 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:15:59 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:15:59 user nova-compute[82184]:       <nova:name>tempest-TestVolumeBootPattern-server-1500776453</nova:name>
Apr 12 02:15:59 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:15:57</nova:creationTime>
Apr 12 02:15:59 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:15:59 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:15:59 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:15:59 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:15:59 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:15:59 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:15:59 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:15:59 user nova-compute[82184]:       <nova:owner>
Apr 12 02:15:59 user nova-compute[82184]:         <nova:user uuid="69d5d81fffb14b1cab84b6160ceb7dd2">tempest-TestVolumeBootPattern-2043953815-project-member</nova:user>
Apr 12 02:15:59 user nova-compute[82184]:         <nova:project uuid="bcd685278576490480a97cd2bc5e048b">tempest-TestVolumeBootPattern-2043953815</nova:project>
Apr 12 02:15:59 user nova-compute[82184]:       </nova:owner>
Apr 12 02:15:59 user nova-compute[82184]:       <nova:ports>
Apr 12 02:15:59 user nova-compute[82184]:         <nova:port uuid="f3bfac63-9965-4cc9-9c67-91d735cdcc43">
Apr 12 02:15:59 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 02:15:59 user nova-compute[82184]:         </nova:port>
Apr 12 02:15:59 user nova-compute[82184]:       </nova:ports>
Apr 12 02:15:59 user nova-compute[82184]:     </nova:instance>
Apr 12 02:15:59 user nova-compute[82184]:   </metadata>
Apr 12 02:15:59 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:15:59 user nova-compute[82184]:     <system>
Apr 12 02:15:59 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:15:59 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:15:59 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:15:59 user nova-compute[82184]:       <entry name="serial">8553081b-42a3-45c9-a6f6-248315547366</entry>
Apr 12 02:15:59 user nova-compute[82184]:       <entry name="uuid">8553081b-42a3-45c9-a6f6-248315547366</entry>
Apr 12 02:15:59 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:15:59 user nova-compute[82184]:     </system>
Apr 12 02:15:59 user nova-compute[82184]:   </sysinfo>
Apr 12 02:15:59 user nova-compute[82184]:   <os>
Apr 12 02:15:59 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:15:59 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:15:59 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:15:59 user nova-compute[82184]:   </os>
Apr 12 02:15:59 user nova-compute[82184]:   <features>
Apr 12 02:15:59 user nova-compute[82184]:     <acpi/>
Apr 12 02:15:59 user nova-compute[82184]:     <apic/>
Apr 12 02:15:59 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:15:59 user nova-compute[82184]:   </features>
Apr 12 02:15:59 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:15:59 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:15:59 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:15:59 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:15:59 user nova-compute[82184]:   </clock>
Apr 12 02:15:59 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:15:59 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:15:59 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:15:59 user nova-compute[82184]:   </cpu>
Apr 12 02:15:59 user nova-compute[82184]:   <devices>
Apr 12 02:15:59 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:15:59 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:15:59 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 02:15:59 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:15:59 user nova-compute[82184]:       <serial>f0dc4ffd-98fa-4a8c-8843-73706a802dc5</serial>
Apr 12 02:15:59 user nova-compute[82184]:     </disk>
Apr 12 02:15:59 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:15:59 user nova-compute[82184]:       <mac address="fa:16:3e:6d:0c:79"/>
Apr 12 02:15:59 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:15:59 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:15:59 user nova-compute[82184]:       <target dev="tapf3bfac63-99"/>
Apr 12 02:15:59 user nova-compute[82184]:     </interface>
Apr 12 02:15:59 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:15:59 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/8553081b-42a3-45c9-a6f6-248315547366/console.log" append="off"/>
Apr 12 02:15:59 user nova-compute[82184]:     </serial>
Apr 12 02:15:59 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:15:59 user nova-compute[82184]:     <video>
Apr 12 02:15:59 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:15:59 user nova-compute[82184]:     </video>
Apr 12 02:15:59 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:15:59 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:15:59 user nova-compute[82184]:     </rng>
Apr 12 02:15:59 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:15:59 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:15:59 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:15:59 user nova-compute[82184]:     </memballoon>
Apr 12 02:15:59 user nova-compute[82184]:   </devices>
Apr 12 02:15:59 user nova-compute[82184]: </domain>
Apr 12 02:15:59 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1500776453',display_name='tempest-TestVolumeBootPattern-server-1500776453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1500776453',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZLzl+dJPPiQ1Q3KddtYvgtfp4Cw3N4yjPTn4jGAIGgcnNkNcoYvsYhuJ1X9VE6SsNAdPUgVuioRnH9/wkBTudNIYOOGxrInu47Q267Lh/dzVGncnNeYWswwovQJnMLew==',key_name='tempest-TestVolumeBootPattern-1281564430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-o9elig80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:15:53Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=8553081b-42a3-45c9-a6f6-248315547366,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:0c:79,bridge_name='br-int',has_traffic_filtering=True,id=f3bfac63-9965-4cc9-9c67-91d735cdcc43,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bfac63-99') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG os_vif [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:0c:79,bridge_name='br-int',has_traffic_filtering=True,id=f3bfac63-9965-4cc9-9c67-91d735cdcc43,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bfac63-99') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3bfac63-99, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3bfac63-99, col_values=(('external_ids', {'iface-id': 'f3bfac63-9965-4cc9-9c67-91d735cdcc43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:0c:79', 'vm-uuid': '8553081b-42a3-45c9-a6f6-248315547366'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:15:59 user nova-compute[82184]: INFO os_vif [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:0c:79,bridge_name='br-int',has_traffic_filtering=True,id=f3bfac63-9965-4cc9-9c67-91d735cdcc43,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bfac63-99')
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:15:59 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No VIF found with MAC fa:16:3e:6d:0c:79, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:16:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-9bf1457e-595e-4845-a152-d458b0683c9f req-e4b350b4-fc48-4cab-bfe1-10aa270430bc service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received event network-vif-plugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:16:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9bf1457e-595e-4845-a152-d458b0683c9f req-e4b350b4-fc48-4cab-bfe1-10aa270430bc service nova] Acquiring lock "8553081b-42a3-45c9-a6f6-248315547366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9bf1457e-595e-4845-a152-d458b0683c9f req-e4b350b4-fc48-4cab-bfe1-10aa270430bc service nova] Lock "8553081b-42a3-45c9-a6f6-248315547366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9bf1457e-595e-4845-a152-d458b0683c9f req-e4b350b4-fc48-4cab-bfe1-10aa270430bc service nova] Lock "8553081b-42a3-45c9-a6f6-248315547366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:00 user nova-compute[82184]: DEBUG nova.compute.manager [req-9bf1457e-595e-4845-a152-d458b0683c9f req-e4b350b4-fc48-4cab-bfe1-10aa270430bc service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] No waiting events found dispatching network-vif-plugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:16:00 user nova-compute[82184]: WARNING nova.compute.manager [req-9bf1457e-595e-4845-a152-d458b0683c9f req-e4b350b4-fc48-4cab-bfe1-10aa270430bc service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received unexpected event network-vif-plugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 for instance with vm_state building and task_state spawning.
Apr 12 02:16:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265762.4429312, 8553081b-42a3-45c9-a6f6-248315547366 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:16:02 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] VM Resumed (Lifecycle Event)
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:16:02 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Instance spawned successfully.
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:16:02 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265762.4440386, 8553081b-42a3-45c9-a6f6-248315547366 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:16:02 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] VM Started (Lifecycle Event)
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:16:02 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:16:02 user nova-compute[82184]: INFO nova.compute.manager [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Took 4.87 seconds to spawn the instance on the hypervisor.
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-77938990-eadf-4541-ad7c-280266ab95ae req-a77c2051-9fb2-4f37-9b98-5c34ec085253 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received event network-vif-plugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-77938990-eadf-4541-ad7c-280266ab95ae req-a77c2051-9fb2-4f37-9b98-5c34ec085253 service nova] Acquiring lock "8553081b-42a3-45c9-a6f6-248315547366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-77938990-eadf-4541-ad7c-280266ab95ae req-a77c2051-9fb2-4f37-9b98-5c34ec085253 service nova] Lock "8553081b-42a3-45c9-a6f6-248315547366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-77938990-eadf-4541-ad7c-280266ab95ae req-a77c2051-9fb2-4f37-9b98-5c34ec085253 service nova] Lock "8553081b-42a3-45c9-a6f6-248315547366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.compute.manager [req-77938990-eadf-4541-ad7c-280266ab95ae req-a77c2051-9fb2-4f37-9b98-5c34ec085253 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] No waiting events found dispatching network-vif-plugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:16:02 user nova-compute[82184]: WARNING nova.compute.manager [req-77938990-eadf-4541-ad7c-280266ab95ae req-a77c2051-9fb2-4f37-9b98-5c34ec085253 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received unexpected event network-vif-plugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 for instance with vm_state building and task_state spawning.
Apr 12 02:16:02 user nova-compute[82184]: INFO nova.compute.manager [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Took 10.02 seconds to build instance.
Apr 12 02:16:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00f01233-0207-4dec-99b6-8b872f8ebcae tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "8553081b-42a3-45c9-a6f6-248315547366" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.128s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:16:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:03 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:16:03 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:16:03 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8566MB free_disk=26.388797760009766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:16:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e6f93d39-5be6-4223-9ac8-362ee29f9e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:16:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:16:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 8553081b-42a3-45c9-a6f6-248315547366 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:16:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:16:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:16:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:04 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:16:04 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:16:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:16:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:06 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:16:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:16:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:16:06 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:16:07 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updating instance_info_cache with network_info: [{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:16:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:16:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:16:07 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:10 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:10 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:16:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:16:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:16:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:16:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:16:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:16:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:16:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:15 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:16:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:16:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'flavor' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:19 user nova-compute[82184]: INFO nova.compute.manager [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Attaching volume bd53833b-60be-44d0-834d-015f87042307 to /dev/vdb
Apr 12 02:16:19 user nova-compute[82184]: DEBUG os_brick.utils [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5d5682-dc5f-432d-9204-e03dd12f7c02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[789b8122-9da5-44f4-92c9-1ec933249819]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[637b09c3-f6cb-4483-ba49-fb0eb4ee870a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[081f8166-b1a5-4d95-a012-b8b8b9dd097f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:16:19 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:16:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ad0353-42b9-407d-8869-4e72d2d8193a]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG os_brick.utils [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:16:19 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating existing volume attachment record: 62df1a5a-9250-4d3a-970f-bb4300eb6ca2 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:16:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzeDjbws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:16:24 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:16:24 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:16:24 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7cd0b0-89e6-4b73-9793-9a881c5e86f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:16:24 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5ae4ab-a376-48ac-87d1-f513c28b495a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307] added
Apr 12 02:16:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4634fa-9eaa-4e13-a973-2deee864dfab]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[10488df2-646b-4dcf-bf6f-d2bbc14c66af]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzeDjbws {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzeDjbws" returned: 0 in 0.032s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[441fcb32-f8ee-420c-972b-187181eb09b7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzeDjbws'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09abdf7-4da9-47ff-b8a5-1224d23fbf6b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a699a8a-873d-48a1-8c10-9ea4e4613421]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:16:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:16:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f886e07-a396-4f8f-b348-d1d254498e73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260]
Apr 12 02:16:24 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260] successful.
Apr 12 02:16:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7271beb9-7a79-4f8b-a8d9-cb162d188690]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a65d3b-452f-453e-9d38-f2ace89f19c6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:16:24 user nova-compute[82184]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:16:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:16:24 user nova-compute[82184]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:16:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c797d9bd-3063-4b28-afeb-8cf5889314e4]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:16:25 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:16:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzeDjbws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:16:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:16:25 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26663373865333531', 'path': '/dev/sdc'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:16:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663373865333531', 'path': '/dev/sdc'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:16:25 user nova-compute[82184]: DEBUG nova.objects.instance [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'flavor' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:16:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:16:25 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:16:25 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 02:16:25 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:16:25 user nova-compute[82184]:   <serial>bd53833b-60be-44d0-834d-015f87042307</serial>
Apr 12 02:16:25 user nova-compute[82184]: </disk>
Apr 12 02:16:25 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:16:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:16:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:16:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] No VIF found with MAC fa:16:3e:98:2c:6a, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:16:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-00176c31-f205-4925-a57c-9d4d53ad5f71 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.497s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:27 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-e78529fa-b8ee-4ae7-bf27-66d1a1687af3 req-74009dd7-1e0b-447b-afe8-fd3ca40ab0c2 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-changed-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-e78529fa-b8ee-4ae7-bf27-66d1a1687af3 req-74009dd7-1e0b-447b-afe8-fd3ca40ab0c2 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Refreshing instance network info cache due to event network-changed-2ee24eda-3ac7-48c9-b117-91371281aa33. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e78529fa-b8ee-4ae7-bf27-66d1a1687af3 req-74009dd7-1e0b-447b-afe8-fd3ca40ab0c2 service nova] Acquiring lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e78529fa-b8ee-4ae7-bf27-66d1a1687af3 req-74009dd7-1e0b-447b-afe8-fd3ca40ab0c2 service nova] Acquired lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG nova.network.neutron [req-e78529fa-b8ee-4ae7-bf27-66d1a1687af3 req-74009dd7-1e0b-447b-afe8-fd3ca40ab0c2 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Refreshing network info cache for port 2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG nova.network.neutron [req-e78529fa-b8ee-4ae7-bf27-66d1a1687af3 req-74009dd7-1e0b-447b-afe8-fd3ca40ab0c2 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updated VIF entry in instance network info cache for port 2ee24eda-3ac7-48c9-b117-91371281aa33. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG nova.network.neutron [req-e78529fa-b8ee-4ae7-bf27-66d1a1687af3 req-74009dd7-1e0b-447b-afe8-fd3ca40ab0c2 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating instance_info_cache with network_info: [{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:16:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e78529fa-b8ee-4ae7-bf27-66d1a1687af3 req-74009dd7-1e0b-447b-afe8-fd3ca40ab0c2 service nova] Releasing lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:16:31 user nova-compute[82184]: INFO nova.compute.manager [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] instance snapshotting
Apr 12 02:16:31 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Beginning live snapshot process
Apr 12 02:16:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-c4a920db-1919-4437-9390-76c967c84be0 req-bf7e20b2-44a2-4eb4-8f19-f3dd0598a882 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-changed-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-c4a920db-1919-4437-9390-76c967c84be0 req-bf7e20b2-44a2-4eb4-8f19-f3dd0598a882 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Refreshing instance network info cache due to event network-changed-2ee24eda-3ac7-48c9-b117-91371281aa33. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c4a920db-1919-4437-9390-76c967c84be0 req-bf7e20b2-44a2-4eb4-8f19-f3dd0598a882 service nova] Acquiring lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c4a920db-1919-4437-9390-76c967c84be0 req-bf7e20b2-44a2-4eb4-8f19-f3dd0598a882 service nova] Acquired lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG nova.network.neutron [req-c4a920db-1919-4437-9390-76c967c84be0 req-bf7e20b2-44a2-4eb4-8f19-f3dd0598a882 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Refreshing network info cache for port 2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json -f qcow2 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json -f qcow2 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG nova.network.neutron [req-c4a920db-1919-4437-9390-76c967c84be0 req-bf7e20b2-44a2-4eb4-8f19-f3dd0598a882 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updated VIF entry in instance network info cache for port 2ee24eda-3ac7-48c9-b117-91371281aa33. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG nova.network.neutron [req-c4a920db-1919-4437-9390-76c967c84be0 req-bf7e20b2-44a2-4eb4-8f19-f3dd0598a882 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating instance_info_cache with network_info: [{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c4a920db-1919-4437-9390-76c967c84be0 req-bf7e20b2-44a2-4eb4-8f19-f3dd0598a882 service nova] Releasing lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.160s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpem_w6h8r/dbb6a9be02874795b3ea66ef1a955779.delta 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpem_w6h8r/dbb6a9be02874795b3ea66ef1a955779.delta 1073741824" returned: 0 in 0.048s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:31 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 02:16:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 02:16:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:32 user nova-compute[82184]: INFO nova.compute.manager [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Rebooting instance
Apr 12 02:16:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:16:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquired lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:16:32 user nova-compute[82184]: DEBUG nova.network.neutron [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:16:32 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 02:16:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 02:16:33 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpem_w6h8r/dbb6a9be02874795b3ea66ef1a955779.delta /opt/stack/data/nova/instances/snapshots/tmpem_w6h8r/dbb6a9be02874795b3ea66ef1a955779 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG nova.network.neutron [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating instance_info_cache with network_info: [{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Releasing lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpem_w6h8r/dbb6a9be02874795b3ea66ef1a955779.delta /opt/stack/data/nova/instances/snapshots/tmpem_w6h8r/dbb6a9be02874795b3ea66ef1a955779" returned: 0 in 0.508s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Snapshot extracted, beginning image upload
Apr 12 02:16:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-217ffa4f-66ac-47ae-8d5d-e68958fad5c1 req-5235125e-a2d0-4b74-8364-6d615527b418 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-vif-unplugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-217ffa4f-66ac-47ae-8d5d-e68958fad5c1 req-5235125e-a2d0-4b74-8364-6d615527b418 service nova] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-217ffa4f-66ac-47ae-8d5d-e68958fad5c1 req-5235125e-a2d0-4b74-8364-6d615527b418 service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-217ffa4f-66ac-47ae-8d5d-e68958fad5c1 req-5235125e-a2d0-4b74-8364-6d615527b418 service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-217ffa4f-66ac-47ae-8d5d-e68958fad5c1 req-5235125e-a2d0-4b74-8364-6d615527b418 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] No waiting events found dispatching network-vif-unplugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:16:33 user nova-compute[82184]: WARNING nova.compute.manager [req-217ffa4f-66ac-47ae-8d5d-e68958fad5c1 req-5235125e-a2d0-4b74-8364-6d615527b418 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received unexpected event network-vif-unplugged-2ee24eda-3ac7-48c9-b117-91371281aa33 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 02:16:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:34 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Instance destroyed successfully.
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.objects.instance [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'resources' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1897008155',display_name='tempest-TestMinimumBasicScenario-server-1897008155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1897008155',id=36,image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9jZCWKV6hxux1R3+C+7uefGfjpgPqW32T2YiNnkme9UOOl4uU3OGWAWXACSx7haDpHOtbD7cTM7r65siGiAgj09hq/+hBvt2qQXd3ZpwfsOyduBx4iSrwxw2ZDVRKj2g==',key_name='tempest-TestMinimumBasicScenario-1687627615',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:14:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b73a0cde174feeb85558cebb13d137',ramdisk_id='',reservation_id='r-gyd5dlif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-934200257',owner_user_name='tempest-TestMinimumBasicScenario-934200257-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:16:34Z,user_data=None,user_id='88570fbc28654337a032da5fa1f58814',uuid=e6f93d39-5be6-4223-9ac8-362ee29f9e22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converting VIF {"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_vif [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ee24eda-3a, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:16:34 user nova-compute[82184]: INFO os_vif [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a')
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzeDjbws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:16:34 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a739ce-35f6-4d64-85be-904fbbb5a0ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:16:34 user nova-compute[82184]: No targets found.
Apr 12 02:16:34 user nova-compute[82184]: iSNS:
Apr 12 02:16:34 user nova-compute[82184]: No targets found.
Apr 12 02:16:34 user nova-compute[82184]: STATIC:
Apr 12 02:16:34 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5
Apr 12 02:16:34 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:16:34 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:16:34 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307
Apr 12 02:16:34 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:16:34 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:16:34 user nova-compute[82184]: FIRMWARE:
Apr 12 02:16:34 user nova-compute[82184]: No targets found.
Apr 12 02:16:34 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:16:34 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:16:34 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed9886c-62f4-420b-aec1-93881627a103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf1c850-b20b-45c1-8d0f-1d12abab084e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:16:34 user nova-compute[82184]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:16:34 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:16:34 user nova-compute[82184]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:16:34 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26882492d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307'): ({'sdc'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Removing single pathed devices sdc {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[911d8b87-9c69-4050-af66-caf7d723d4a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c4dec3-f97e-41a8-9a80-544ccfe5ba01]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Flushing IO for device /dev/sdc {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[746238d4-5964-4077-bcac-76d21d1bed06]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9450eed1-e718-4d27-8ed5-dc91187266bc]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8554db1-730d-4e7f-a8ed-9c916ddc88d4]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e15588-b084-45be-9558-d35d77649bb9]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260]
Apr 12 02:16:34 user nova-compute[82184]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260] successful.
Apr 12 02:16:34 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e717f32c-43b7-4d91-970c-f2b0dcfb6b05]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] <== disconnect_volume: return (284ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Start _get_guest_xml network_info=[{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=844b59ea-88c3-4180-bac8-c8fed5694334,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '844b59ea-88c3-4180-bac8-c8fed5694334'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'attachment_id': '62df1a5a-9250-4d3a-970f-bb4300eb6ca2', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzeDjbws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e6f93d39-5be6-4223-9ac8-362ee29f9e22', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd53833b-60be-44d0-834d-015f87042307', 'serial': 'bd53833b-60be-44d0-834d-015f87042307'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:16:34 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:16:34 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=844b59ea-88c3-4180-bac8-c8fed5694334,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.objects.instance [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzeDjbws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:16:34 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:16:34 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:16:34 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5c1ef3-d1fe-44d8-83a4-48bfb3194471]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:16:34 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[530dd7e0-7b17-4cf2-9ec5-cd50b3564594]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307] added
Apr 12 02:16:34 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e0e4b2-3f01-4bc5-8a33-857f35f73135]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83e9704-6944-42cb-b219-558ce551ab6b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzeDjbws {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzeDjbws" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5b4974-211a-4c04-bdab-4949a99ed7e3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzeDjbws'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0b1781-45e4-42cf-a86d-333898be5081]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[838eb943-ea64-41c7-9587-c123450e0a2f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:16:34 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:16:34 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:16:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c2ea90-1541-4206-9778-a538697d0ffb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260]
Apr 12 02:16:35 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260] successful.
Apr 12 02:16:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[445a883f-cce3-4ba5-9643-8bb0e4e9fa24]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab88233-b1a3-48df-9499-e8cfef65e9ee]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:16:35 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:16:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:16:35 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:16:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe59f24-4c7d-4de8-b8f2-39181e83fb51]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzeDjbws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:16:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Snapshot image upload complete
Apr 12 02:16:35 user nova-compute[82184]: INFO nova.compute.manager [None req-5ccec886-3d2f-4e0c-81bc-ad55efc6b442 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Took 4.70 seconds to snapshot the instance on the hypervisor.
Apr 12 02:16:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-75fbc7d9-da2f-4740-9c6a-fc0d2b81723f req-86d4f469-66a6-4725-96fa-fef3c63b43e4 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-75fbc7d9-da2f-4740-9c6a-fc0d2b81723f req-86d4f469-66a6-4725-96fa-fef3c63b43e4 service nova] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-75fbc7d9-da2f-4740-9c6a-fc0d2b81723f req-86d4f469-66a6-4725-96fa-fef3c63b43e4 service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-75fbc7d9-da2f-4740-9c6a-fc0d2b81723f req-86d4f469-66a6-4725-96fa-fef3c63b43e4 service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-75fbc7d9-da2f-4740-9c6a-fc0d2b81723f req-86d4f469-66a6-4725-96fa-fef3c63b43e4 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] No waiting events found dispatching network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:16:35 user nova-compute[82184]: WARNING nova.compute.manager [req-75fbc7d9-da2f-4740-9c6a-fc0d2b81723f req-86d4f469-66a6-4725-96fa-fef3c63b43e4 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received unexpected event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 02:16:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26663373865333531', 'path': '/dev/sdc'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663373865333531', 'path': '/dev/sdc'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1897008155',display_name='tempest-TestMinimumBasicScenario-server-1897008155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1897008155',id=36,image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9jZCWKV6hxux1R3+C+7uefGfjpgPqW32T2YiNnkme9UOOl4uU3OGWAWXACSx7haDpHOtbD7cTM7r65siGiAgj09hq/+hBvt2qQXd3ZpwfsOyduBx4iSrwxw2ZDVRKj2g==',key_name='tempest-TestMinimumBasicScenario-1687627615',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:14:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b73a0cde174feeb85558cebb13d137',ramdisk_id='',reservation_id='r-gyd5dlif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-934200257',owner_user_name='tempest-TestMinimumBasicScenario-934200257-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:16:34Z,user_data=None,user_id='88570fbc28654337a032da5fa1f58814',uuid=e6f93d39-5be6-4223-9ac8-362ee29f9e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converting VIF {"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'pci_devices' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:16:36 user nova-compute[82184]:   <uuid>e6f93d39-5be6-4223-9ac8-362ee29f9e22</uuid>
Apr 12 02:16:36 user nova-compute[82184]:   <name>instance-00000024</name>
Apr 12 02:16:36 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:16:36 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:16:36 user nova-compute[82184]:   <metadata>
Apr 12 02:16:36 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:16:36 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:16:36 user nova-compute[82184]:       <nova:name>tempest-TestMinimumBasicScenario-server-1897008155</nova:name>
Apr 12 02:16:36 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:16:34</nova:creationTime>
Apr 12 02:16:36 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:16:36 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:16:36 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:16:36 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:16:36 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:16:36 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:16:36 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:16:36 user nova-compute[82184]:       <nova:owner>
Apr 12 02:16:36 user nova-compute[82184]:         <nova:user uuid="88570fbc28654337a032da5fa1f58814">tempest-TestMinimumBasicScenario-934200257-project-member</nova:user>
Apr 12 02:16:36 user nova-compute[82184]:         <nova:project uuid="71b73a0cde174feeb85558cebb13d137">tempest-TestMinimumBasicScenario-934200257</nova:project>
Apr 12 02:16:36 user nova-compute[82184]:       </nova:owner>
Apr 12 02:16:36 user nova-compute[82184]:       <nova:root type="image" uuid="844b59ea-88c3-4180-bac8-c8fed5694334"/>
Apr 12 02:16:36 user nova-compute[82184]:       <nova:ports>
Apr 12 02:16:36 user nova-compute[82184]:         <nova:port uuid="2ee24eda-3ac7-48c9-b117-91371281aa33">
Apr 12 02:16:36 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 02:16:36 user nova-compute[82184]:         </nova:port>
Apr 12 02:16:36 user nova-compute[82184]:       </nova:ports>
Apr 12 02:16:36 user nova-compute[82184]:     </nova:instance>
Apr 12 02:16:36 user nova-compute[82184]:   </metadata>
Apr 12 02:16:36 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:16:36 user nova-compute[82184]:     <system>
Apr 12 02:16:36 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:16:36 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:16:36 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:16:36 user nova-compute[82184]:       <entry name="serial">e6f93d39-5be6-4223-9ac8-362ee29f9e22</entry>
Apr 12 02:16:36 user nova-compute[82184]:       <entry name="uuid">e6f93d39-5be6-4223-9ac8-362ee29f9e22</entry>
Apr 12 02:16:36 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:16:36 user nova-compute[82184]:     </system>
Apr 12 02:16:36 user nova-compute[82184]:   </sysinfo>
Apr 12 02:16:36 user nova-compute[82184]:   <os>
Apr 12 02:16:36 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:16:36 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:16:36 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:16:36 user nova-compute[82184]:   </os>
Apr 12 02:16:36 user nova-compute[82184]:   <features>
Apr 12 02:16:36 user nova-compute[82184]:     <acpi/>
Apr 12 02:16:36 user nova-compute[82184]:     <apic/>
Apr 12 02:16:36 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:16:36 user nova-compute[82184]:   </features>
Apr 12 02:16:36 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:16:36 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:16:36 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:16:36 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:16:36 user nova-compute[82184]:   </clock>
Apr 12 02:16:36 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:16:36 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:16:36 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:16:36 user nova-compute[82184]:   </cpu>
Apr 12 02:16:36 user nova-compute[82184]:   <devices>
Apr 12 02:16:36 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:16:36 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:16:36 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk"/>
Apr 12 02:16:36 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:16:36 user nova-compute[82184]:     </disk>
Apr 12 02:16:36 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:16:36 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:16:36 user nova-compute[82184]:       <source dev="/dev/sdc"/>
Apr 12 02:16:36 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 02:16:36 user nova-compute[82184]:       <serial>bd53833b-60be-44d0-834d-015f87042307</serial>
Apr 12 02:16:36 user nova-compute[82184]:     </disk>
Apr 12 02:16:36 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:16:36 user nova-compute[82184]:       <mac address="fa:16:3e:98:2c:6a"/>
Apr 12 02:16:36 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:16:36 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:16:36 user nova-compute[82184]:       <target dev="tap2ee24eda-3a"/>
Apr 12 02:16:36 user nova-compute[82184]:     </interface>
Apr 12 02:16:36 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:16:36 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/console.log" append="off"/>
Apr 12 02:16:36 user nova-compute[82184]:     </serial>
Apr 12 02:16:36 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:16:36 user nova-compute[82184]:     <video>
Apr 12 02:16:36 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:16:36 user nova-compute[82184]:     </video>
Apr 12 02:16:36 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:16:36 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:16:36 user nova-compute[82184]:     </rng>
Apr 12 02:16:36 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:16:36 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:16:36 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:16:36 user nova-compute[82184]:     </memballoon>
Apr 12 02:16:36 user nova-compute[82184]:   </devices>
Apr 12 02:16:36 user nova-compute[82184]: </domain>
Apr 12 02:16:36 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Cannot resize image /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'migration_context' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1897008155',display_name='tempest-TestMinimumBasicScenario-server-1897008155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1897008155',id=36,image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9jZCWKV6hxux1R3+C+7uefGfjpgPqW32T2YiNnkme9UOOl4uU3OGWAWXACSx7haDpHOtbD7cTM7r65siGiAgj09hq/+hBvt2qQXd3ZpwfsOyduBx4iSrwxw2ZDVRKj2g==',key_name='tempest-TestMinimumBasicScenario-1687627615',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:14:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='71b73a0cde174feeb85558cebb13d137',ramdisk_id='',reservation_id='r-gyd5dlif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-934200257',owner_user_name='tempest-TestMinimumBasicScenario-934200257-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:16:34Z,user_data=None,user_id='88570fbc28654337a032da5fa1f58814',uuid=e6f93d39-5be6-4223-9ac8-362ee29f9e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converting VIF {"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG os_vif [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ee24eda-3a, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ee24eda-3a, col_values=(('external_ids', {'iface-id': '2ee24eda-3ac7-48c9-b117-91371281aa33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:2c:6a', 'vm-uuid': 'e6f93d39-5be6-4223-9ac8-362ee29f9e22'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:16:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:36 user nova-compute[82184]: INFO os_vif [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a')
Apr 12 02:16:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f171822-7dd0-4048-888a-794272b6ecf5 req-3940eea4-7363-40d1-9863-1d405e7263af service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:16:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f171822-7dd0-4048-888a-794272b6ecf5 req-3940eea4-7363-40d1-9863-1d405e7263af service nova] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f171822-7dd0-4048-888a-794272b6ecf5 req-3940eea4-7363-40d1-9863-1d405e7263af service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f171822-7dd0-4048-888a-794272b6ecf5 req-3940eea4-7363-40d1-9863-1d405e7263af service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f171822-7dd0-4048-888a-794272b6ecf5 req-3940eea4-7363-40d1-9863-1d405e7263af service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] No waiting events found dispatching network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:16:38 user nova-compute[82184]: WARNING nova.compute.manager [req-5f171822-7dd0-4048-888a-794272b6ecf5 req-3940eea4-7363-40d1-9863-1d405e7263af service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received unexpected event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 for instance with vm_state active and task_state reboot_started_hard.
Apr 12 02:16:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 3036c0b5-7987-4ff5-9edf-ee7397cf7beb {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 8553081b-42a3-45c9-a6f6-248315547366 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "8553081b-42a3-45c9-a6f6-248315547366" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "8553081b-42a3-45c9-a6f6-248315547366" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "8553081b-42a3-45c9-a6f6-248315547366" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for e6f93d39-5be6-4223-9ac8-362ee29f9e22 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265800.153901, e6f93d39-5be6-4223-9ac8-362ee29f9e22 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:16:40 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] VM Resumed (Lifecycle Event)
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:16:40 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Instance rebooted successfully.
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:16:40 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265800.1576831, e6f93d39-5be6-4223-9ac8-362ee29f9e22 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:16:40 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] VM Started (Lifecycle Event)
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de8a2a8c-76ce-435b-917d-c2f14ae602bc tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.400s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.217s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:40 user nova-compute[82184]: INFO nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 12 02:16:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-3d1c1f13-7894-4de4-b26b-0ddd8975efbb req-d4455868-a594-4a68-87d0-461370143e5d service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d1c1f13-7894-4de4-b26b-0ddd8975efbb req-d4455868-a594-4a68-87d0-461370143e5d service nova] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d1c1f13-7894-4de4-b26b-0ddd8975efbb req-d4455868-a594-4a68-87d0-461370143e5d service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3d1c1f13-7894-4de4-b26b-0ddd8975efbb req-d4455868-a594-4a68-87d0-461370143e5d service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:16:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-3d1c1f13-7894-4de4-b26b-0ddd8975efbb req-d4455868-a594-4a68-87d0-461370143e5d service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] No waiting events found dispatching network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:16:40 user nova-compute[82184]: WARNING nova.compute.manager [req-3d1c1f13-7894-4de4-b26b-0ddd8975efbb req-d4455868-a594-4a68-87d0-461370143e5d service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received unexpected event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 for instance with vm_state active and task_state None.
Apr 12 02:16:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:16:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:17:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:17:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:02 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:17:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:17:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:17:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:17:03 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:17:03 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:17:03 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8495MB free_disk=26.350223541259766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:17:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e6f93d39-5be6-4223-9ac8-362ee29f9e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 8553081b-42a3-45c9-a6f6-248315547366 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:17:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating instance_info_cache with network_info: [{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:17:07 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:17:08 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:17:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:17:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:17:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:17:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:17:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:17:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:17:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:17:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:17:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:17:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:17:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:17:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:17:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:17:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:17:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:17:37 user nova-compute[82184]: INFO nova.compute.claims [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Claim successful on node user
Apr 12 02:17:37 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:17:37 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:17:37 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:17:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:17:37 user nova-compute[82184]: INFO nova.virt.block_device [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Booting with blank volume at /dev/vda
Apr 12 02:17:37 user nova-compute[82184]: DEBUG nova.policy [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe9217f4c1ff428086140b7fd07194eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb951049b464316a04647ce9c52963a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:17:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:38 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Successfully created port: 217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Successfully updated port: 217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquired lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-aebe4364-ae01-4e25-92da-112f054d276f req-bd20d6da-a3c5-4912-b518-713a60155bf1 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-changed-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-aebe4364-ae01-4e25-92da-112f054d276f req-bd20d6da-a3c5-4912-b518-713a60155bf1 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Refreshing instance network info cache due to event network-changed-217714fd-b1ef-4cf0-8f00-ec948d907b1b. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aebe4364-ae01-4e25-92da-112f054d276f req-bd20d6da-a3c5-4912-b518-713a60155bf1 service nova] Acquiring lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updating instance_info_cache with network_info: [{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Releasing lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Instance network_info: |[{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aebe4364-ae01-4e25-92da-112f054d276f req-bd20d6da-a3c5-4912-b518-713a60155bf1 service nova] Acquired lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:17:39 user nova-compute[82184]: DEBUG nova.network.neutron [req-aebe4364-ae01-4e25-92da-112f054d276f req-bd20d6da-a3c5-4912-b518-713a60155bf1 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Refreshing network info cache for port 217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:17:40 user nova-compute[82184]: DEBUG nova.network.neutron [req-aebe4364-ae01-4e25-92da-112f054d276f req-bd20d6da-a3c5-4912-b518-713a60155bf1 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updated VIF entry in instance network info cache for port 217714fd-b1ef-4cf0-8f00-ec948d907b1b. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:17:40 user nova-compute[82184]: DEBUG nova.network.neutron [req-aebe4364-ae01-4e25-92da-112f054d276f req-bd20d6da-a3c5-4912-b518-713a60155bf1 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updating instance_info_cache with network_info: [{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:17:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aebe4364-ae01-4e25-92da-112f054d276f req-bd20d6da-a3c5-4912-b518-713a60155bf1 service nova] Releasing lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:17:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG os_brick.utils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f19467-ea64-4ceb-8b7d-fe1e68e49e42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff3479d-0d12-4f60-b403-ca80b79ce7fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27690cb8-b1e3-414d-a16f-c0f2c1dea722]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5812f7f-7fce-44de-9bf8-746d700cf1ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:17:43 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:17:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c154a2b-7fcf-4643-a55c-eee47cb1c744]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG os_brick.utils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:17:43 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updating existing volume attachment record: e6f594af-5a63-43df-9f98-aac9b8ce0a7b {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:17:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-302815b2-30c3-40c1-ad75-47b1eb711e66 req-4ce8500d-4328-420e-9abd-f6f1110a8903 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received event network-changed-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:17:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-302815b2-30c3-40c1-ad75-47b1eb711e66 req-4ce8500d-4328-420e-9abd-f6f1110a8903 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Refreshing instance network info cache due to event network-changed-f3bfac63-9965-4cc9-9c67-91d735cdcc43. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:17:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-302815b2-30c3-40c1-ad75-47b1eb711e66 req-4ce8500d-4328-420e-9abd-f6f1110a8903 service nova] Acquiring lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:17:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-302815b2-30c3-40c1-ad75-47b1eb711e66 req-4ce8500d-4328-420e-9abd-f6f1110a8903 service nova] Acquired lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:17:44 user nova-compute[82184]: DEBUG nova.network.neutron [req-302815b2-30c3-40c1-ad75-47b1eb711e66 req-4ce8500d-4328-420e-9abd-f6f1110a8903 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Refreshing network info cache for port f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:17:44 user nova-compute[82184]: DEBUG nova.network.neutron [req-302815b2-30c3-40c1-ad75-47b1eb711e66 req-4ce8500d-4328-420e-9abd-f6f1110a8903 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updated VIF entry in instance network info cache for port f3bfac63-9965-4cc9-9c67-91d735cdcc43. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:17:44 user nova-compute[82184]: DEBUG nova.network.neutron [req-302815b2-30c3-40c1-ad75-47b1eb711e66 req-4ce8500d-4328-420e-9abd-f6f1110a8903 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updating instance_info_cache with network_info: [{"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:17:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-302815b2-30c3-40c1-ad75-47b1eb711e66 req-4ce8500d-4328-420e-9abd-f6f1110a8903 service nova] Releasing lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:17:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:17:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:17:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:17:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:17:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:17:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:17:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Creating image(s)
Apr 12 02:17:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:17:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Ensure instance console log exists: /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:17:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Start _get_guest_xml network_info=[{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'e6f594af-5a63-43df-9f98-aac9b8ce0a7b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDcoqanN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '811c4fb7-d984-461e-9190-4d0e9ec345c2', 'attached_at': '', 'detached_at': '', 'volume_id': '774cf9c9-daf1-4a88-8b14-008fd044bf34', 'serial': '774cf9c9-daf1-4a88-8b14-008fd044bf34'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:17:47 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:17:47 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDcoqanN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:17:48 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:17:48 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:17:48 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2918610-6251-4bc8-aafb-6320c0df6018]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:17:48 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d87508-9231-48cd-bc0e-9639de5fc063]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34] added
Apr 12 02:17:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f520aa-ee17-415c-a161-5e14e483ae07]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1975da-c799-4cab-8d8c-cbcf46ba6e5f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UDcoqanN {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UDcoqanN" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[120e5b17-d23c-4b1b-b9dd-ed65613b34a1]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UDcoqanN'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[989f8f58-7d7a-41ff-9eb1-617545b22011]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef1b9f6-9872-4777-883a-4d437302dab0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:17:48 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:17:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:17:48 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:17:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f219562b-0bdd-43cf-9757-1f07497c02eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34, portal: 172.16.0.220,3260]
Apr 12 02:17:48 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34, portal: 172.16.0.220,3260] successful.
Apr 12 02:17:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5555a963-92fd-4b33-8a2a-9e63f8b99438]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd83ddaa-0106-4d52-8e9a-6d139cde70bc]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:17:48 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:17:48 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:17:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:17:48 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:17:48 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:17:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7431dccb-7d39-4042-839b-1bc32ab09cad]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDcoqanN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "7280568b-5a65-43ab-b645-605ea5652324" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:17:48 user nova-compute[82184]: INFO nova.compute.claims [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Claim successful on node user
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:17:48 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:17:48 user nova-compute[82184]: INFO nova.virt.block_device [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Booting with volume 452f1fa1-24b2-4afe-995f-25e0b08aa4a4 at /dev/vda
Apr 12 02:17:48 user nova-compute[82184]: DEBUG os_brick.utils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG nova.policy [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69d5d81fffb14b1cab84b6160ceb7dd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd685278576490480a97cd2bc5e048b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33888a34-a4cd-4b9a-b78c-cca6d1a0e8d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c309bccc-2d86-4686-af4f-ad914f1f4979]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a8ee6a-1939-42e7-bfb6-961d2bf0ec1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be44d21-5090-4f45-84cd-0213cecceae0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:17:49 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:17:49 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[25410d1f-25e9-4f47-bf52-c68bbf7acca8]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG os_brick.utils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Updating existing volume attachment record: aae6451a-8d49-4a6c-956e-6338da8e0e21 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23639626165373932', 'path': '/dev/sdd'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639626165373932', 'path': '/dev/sdd'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839044150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839044150',id=39,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-a1daltq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:17:38Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=811c4fb7-d984-461e-9190-4d0e9ec345c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=217714fd-b1ef-4cf0-8f00-ec948d907b1b,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217714fd-b1') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'pci_devices' on Instance uuid 811c4fb7-d984-461e-9190-4d0e9ec345c2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:17:49 user nova-compute[82184]:   <uuid>811c4fb7-d984-461e-9190-4d0e9ec345c2</uuid>
Apr 12 02:17:49 user nova-compute[82184]:   <name>instance-00000027</name>
Apr 12 02:17:49 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:17:49 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:17:49 user nova-compute[82184]:   <metadata>
Apr 12 02:17:49 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:17:49 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:17:49 user nova-compute[82184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1839044150</nova:name>
Apr 12 02:17:49 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:17:47</nova:creationTime>
Apr 12 02:17:49 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:17:49 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:17:49 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:17:49 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:17:49 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:17:49 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:17:49 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:17:49 user nova-compute[82184]:       <nova:owner>
Apr 12 02:17:49 user nova-compute[82184]:         <nova:user uuid="fe9217f4c1ff428086140b7fd07194eb">tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member</nova:user>
Apr 12 02:17:49 user nova-compute[82184]:         <nova:project uuid="6bb951049b464316a04647ce9c52963a">tempest-ServerBootFromVolumeStableRescueTest-1070279577</nova:project>
Apr 12 02:17:49 user nova-compute[82184]:       </nova:owner>
Apr 12 02:17:49 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:17:49 user nova-compute[82184]:       <nova:ports>
Apr 12 02:17:49 user nova-compute[82184]:         <nova:port uuid="217714fd-b1ef-4cf0-8f00-ec948d907b1b">
Apr 12 02:17:49 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 02:17:49 user nova-compute[82184]:         </nova:port>
Apr 12 02:17:49 user nova-compute[82184]:       </nova:ports>
Apr 12 02:17:49 user nova-compute[82184]:     </nova:instance>
Apr 12 02:17:49 user nova-compute[82184]:   </metadata>
Apr 12 02:17:49 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:17:49 user nova-compute[82184]:     <system>
Apr 12 02:17:49 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:17:49 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:17:49 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:17:49 user nova-compute[82184]:       <entry name="serial">811c4fb7-d984-461e-9190-4d0e9ec345c2</entry>
Apr 12 02:17:49 user nova-compute[82184]:       <entry name="uuid">811c4fb7-d984-461e-9190-4d0e9ec345c2</entry>
Apr 12 02:17:49 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:17:49 user nova-compute[82184]:     </system>
Apr 12 02:17:49 user nova-compute[82184]:   </sysinfo>
Apr 12 02:17:49 user nova-compute[82184]:   <os>
Apr 12 02:17:49 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:17:49 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:17:49 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:17:49 user nova-compute[82184]:   </os>
Apr 12 02:17:49 user nova-compute[82184]:   <features>
Apr 12 02:17:49 user nova-compute[82184]:     <acpi/>
Apr 12 02:17:49 user nova-compute[82184]:     <apic/>
Apr 12 02:17:49 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:17:49 user nova-compute[82184]:   </features>
Apr 12 02:17:49 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:17:49 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:17:49 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:17:49 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:17:49 user nova-compute[82184]:   </clock>
Apr 12 02:17:49 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:17:49 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:17:49 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:17:49 user nova-compute[82184]:   </cpu>
Apr 12 02:17:49 user nova-compute[82184]:   <devices>
Apr 12 02:17:49 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:17:49 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:17:49 user nova-compute[82184]:       <source dev="/dev/sdd"/>
Apr 12 02:17:49 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:17:49 user nova-compute[82184]:       <serial>774cf9c9-daf1-4a88-8b14-008fd044bf34</serial>
Apr 12 02:17:49 user nova-compute[82184]:     </disk>
Apr 12 02:17:49 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:17:49 user nova-compute[82184]:       <mac address="fa:16:3e:47:c2:75"/>
Apr 12 02:17:49 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:17:49 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:17:49 user nova-compute[82184]:       <target dev="tap217714fd-b1"/>
Apr 12 02:17:49 user nova-compute[82184]:     </interface>
Apr 12 02:17:49 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:17:49 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/console.log" append="off"/>
Apr 12 02:17:49 user nova-compute[82184]:     </serial>
Apr 12 02:17:49 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:17:49 user nova-compute[82184]:     <video>
Apr 12 02:17:49 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:17:49 user nova-compute[82184]:     </video>
Apr 12 02:17:49 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:17:49 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:17:49 user nova-compute[82184]:     </rng>
Apr 12 02:17:49 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:17:49 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:17:49 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:17:49 user nova-compute[82184]:     </memballoon>
Apr 12 02:17:49 user nova-compute[82184]:   </devices>
Apr 12 02:17:49 user nova-compute[82184]: </domain>
Apr 12 02:17:49 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839044150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839044150',id=39,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-a1daltq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:17:38Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=811c4fb7-d984-461e-9190-4d0e9ec345c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=217714fd-b1ef-4cf0-8f00-ec948d907b1b,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217714fd-b1') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG os_vif [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=217714fd-b1ef-4cf0-8f00-ec948d907b1b,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217714fd-b1') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap217714fd-b1, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap217714fd-b1, col_values=(('external_ids', {'iface-id': '217714fd-b1ef-4cf0-8f00-ec948d907b1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:c2:75', 'vm-uuid': '811c4fb7-d984-461e-9190-4d0e9ec345c2'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:49 user nova-compute[82184]: INFO os_vif [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=217714fd-b1ef-4cf0-8f00-ec948d907b1b,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217714fd-b1')
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No VIF found with MAC fa:16:3e:47:c2:75, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:17:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Successfully created port: 26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Successfully updated port: 26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquired lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-2940a91e-5d76-4075-9f39-5ed4a3f5050f req-55257c4b-5376-4386-809d-596c2d18ceaf service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-changed-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-2940a91e-5d76-4075-9f39-5ed4a3f5050f req-55257c4b-5376-4386-809d-596c2d18ceaf service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Refreshing instance network info cache due to event network-changed-26028cc6-2fb8-44a6-8ecb-26e121018cc1. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2940a91e-5d76-4075-9f39-5ed4a3f5050f req-55257c4b-5376-4386-809d-596c2d18ceaf service nova] Acquiring lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Updating instance_info_cache with network_info: [{"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Releasing lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Instance network_info: |[{"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2940a91e-5d76-4075-9f39-5ed4a3f5050f req-55257c4b-5376-4386-809d-596c2d18ceaf service nova] Acquired lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG nova.network.neutron [req-2940a91e-5d76-4075-9f39-5ed4a3f5050f req-55257c4b-5376-4386-809d-596c2d18ceaf service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Refreshing network info cache for port 26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-9a51e0b8-3f72-4c45-a17a-36e3a2f2ee77 req-2b3a99e4-9f21-4526-b7c2-cf7b3107955a service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9a51e0b8-3f72-4c45-a17a-36e3a2f2ee77 req-2b3a99e4-9f21-4526-b7c2-cf7b3107955a service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9a51e0b8-3f72-4c45-a17a-36e3a2f2ee77 req-2b3a99e4-9f21-4526-b7c2-cf7b3107955a service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9a51e0b8-3f72-4c45-a17a-36e3a2f2ee77 req-2b3a99e4-9f21-4526-b7c2-cf7b3107955a service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-9a51e0b8-3f72-4c45-a17a-36e3a2f2ee77 req-2b3a99e4-9f21-4526-b7c2-cf7b3107955a service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:17:50 user nova-compute[82184]: WARNING nova.compute.manager [req-9a51e0b8-3f72-4c45-a17a-36e3a2f2ee77 req-2b3a99e4-9f21-4526-b7c2-cf7b3107955a service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state building and task_state spawning.
Apr 12 02:17:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:51 user nova-compute[82184]: DEBUG nova.network.neutron [req-2940a91e-5d76-4075-9f39-5ed4a3f5050f req-55257c4b-5376-4386-809d-596c2d18ceaf service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Updated VIF entry in instance network info cache for port 26028cc6-2fb8-44a6-8ecb-26e121018cc1. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:17:51 user nova-compute[82184]: DEBUG nova.network.neutron [req-2940a91e-5d76-4075-9f39-5ed4a3f5050f req-55257c4b-5376-4386-809d-596c2d18ceaf service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Updating instance_info_cache with network_info: [{"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:17:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2940a91e-5d76-4075-9f39-5ed4a3f5050f req-55257c4b-5376-4386-809d-596c2d18ceaf service nova] Releasing lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:17:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265872.9463181, 811c4fb7-d984-461e-9190-4d0e9ec345c2 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:17:52 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] VM Resumed (Lifecycle Event)
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:17:52 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Instance spawned successfully.
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:52 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:17:52 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265872.9509878, 811c4fb7-d984-461e-9190-4d0e9ec345c2 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:17:52 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] VM Started (Lifecycle Event)
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:17:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6da655c-8ac9-4e4a-9646-bec425e7f87a req-e416e4ce-f9a2-4658-a406-78917263ea33 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6da655c-8ac9-4e4a-9646-bec425e7f87a req-e416e4ce-f9a2-4658-a406-78917263ea33 service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6da655c-8ac9-4e4a-9646-bec425e7f87a req-e416e4ce-f9a2-4658-a406-78917263ea33 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b6da655c-8ac9-4e4a-9646-bec425e7f87a req-e416e4ce-f9a2-4658-a406-78917263ea33 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-b6da655c-8ac9-4e4a-9646-bec425e7f87a req-e416e4ce-f9a2-4658-a406-78917263ea33 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:17:53 user nova-compute[82184]: WARNING nova.compute.manager [req-b6da655c-8ac9-4e4a-9646-bec425e7f87a req-e416e4ce-f9a2-4658-a406-78917263ea33 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state building and task_state spawning.
Apr 12 02:17:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Took 5.10 seconds to spawn the instance on the hypervisor.
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:17:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Took 15.83 seconds to build instance.
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d47f4bd3-ad21-4f01-95de-09c8d39d73c9 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.932s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:17:53 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Creating image(s)
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Ensure instance console log exists: /opt/stack/data/nova/instances/7280568b-5a65-43ab-b645-605ea5652324/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Start _get_guest_xml network_info=[{"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'aae6451a-8d49-4a6c-956e-6338da8e0e21', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNactjzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7280568b-5a65-43ab-b645-605ea5652324', 'attached_at': '', 'detached_at': '', 'volume_id': '452f1fa1-24b2-4afe-995f-25e0b08aa4a4', 'serial': '452f1fa1-24b2-4afe-995f-25e0b08aa4a4'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:17:53 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:17:53 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNactjzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:17:53 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:17:53 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:17:53 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[382e3c68-df68-4759-bce6-a1fd956df421]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:17:53 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[993924af-6fd7-497f-99a8-dc8531928504]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4] added
Apr 12 02:17:53 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8835a8-da9c-4a9a-a428-ffc565b461e5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f3b59c-1af7-46e7-af3c-a6e76ea97683]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNactjzW {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNactjzW" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2408b1-9d77-4fff-be0e-b11298300c54]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PNactjzW'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6174f886-39c2-481e-8af1-7d94cfc1c7b3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8556b0-810c-4da3-a07f-a09b51631777]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca68b1c-9d93-4094-82db-be547dd33cfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4, portal: 172.16.0.220,3260]
Apr 12 02:17:53 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4, portal: 172.16.0.220,3260] successful.
Apr 12 02:17:53 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f2c20-7d76-4d32-96e1-77464f1ce771]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a0f5b-45d9-445a-9111-f593ece26437]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)
Apr 12 02:17:53 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78423a25-5aa6-4f20-8927-698cfbf82574]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:17:53 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNactjzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23761633935373930', 'path': '/dev/sde'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761633935373930', 'path': '/dev/sde'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1832739782',display_name='tempest-TestVolumeBootPattern-server-1832739782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1832739782',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZLzl+dJPPiQ1Q3KddtYvgtfp4Cw3N4yjPTn4jGAIGgcnNkNcoYvsYhuJ1X9VE6SsNAdPUgVuioRnH9/wkBTudNIYOOGxrInu47Q267Lh/dzVGncnNeYWswwovQJnMLew==',key_name='tempest-TestVolumeBootPattern-1281564430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-qb46gjnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:17:49Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=7280568b-5a65-43ab-b645-605ea5652324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:30:dc,bridge_name='br-int',has_traffic_filtering=True,id=26028cc6-2fb8-44a6-8ecb-26e121018cc1,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26028cc6-2f') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG nova.objects.instance [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'pci_devices' on Instance uuid 7280568b-5a65-43ab-b645-605ea5652324 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:17:54 user nova-compute[82184]:   <uuid>7280568b-5a65-43ab-b645-605ea5652324</uuid>
Apr 12 02:17:54 user nova-compute[82184]:   <name>instance-00000028</name>
Apr 12 02:17:54 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:17:54 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:17:54 user nova-compute[82184]:   <metadata>
Apr 12 02:17:54 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:17:54 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:17:54 user nova-compute[82184]:       <nova:name>tempest-TestVolumeBootPattern-server-1832739782</nova:name>
Apr 12 02:17:54 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:17:53</nova:creationTime>
Apr 12 02:17:54 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:17:54 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:17:54 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:17:54 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:17:54 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:17:54 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:17:54 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:17:54 user nova-compute[82184]:       <nova:owner>
Apr 12 02:17:54 user nova-compute[82184]:         <nova:user uuid="69d5d81fffb14b1cab84b6160ceb7dd2">tempest-TestVolumeBootPattern-2043953815-project-member</nova:user>
Apr 12 02:17:54 user nova-compute[82184]:         <nova:project uuid="bcd685278576490480a97cd2bc5e048b">tempest-TestVolumeBootPattern-2043953815</nova:project>
Apr 12 02:17:54 user nova-compute[82184]:       </nova:owner>
Apr 12 02:17:54 user nova-compute[82184]:       <nova:ports>
Apr 12 02:17:54 user nova-compute[82184]:         <nova:port uuid="26028cc6-2fb8-44a6-8ecb-26e121018cc1">
Apr 12 02:17:54 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 02:17:54 user nova-compute[82184]:         </nova:port>
Apr 12 02:17:54 user nova-compute[82184]:       </nova:ports>
Apr 12 02:17:54 user nova-compute[82184]:     </nova:instance>
Apr 12 02:17:54 user nova-compute[82184]:   </metadata>
Apr 12 02:17:54 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:17:54 user nova-compute[82184]:     <system>
Apr 12 02:17:54 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:17:54 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:17:54 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:17:54 user nova-compute[82184]:       <entry name="serial">7280568b-5a65-43ab-b645-605ea5652324</entry>
Apr 12 02:17:54 user nova-compute[82184]:       <entry name="uuid">7280568b-5a65-43ab-b645-605ea5652324</entry>
Apr 12 02:17:54 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:17:54 user nova-compute[82184]:     </system>
Apr 12 02:17:54 user nova-compute[82184]:   </sysinfo>
Apr 12 02:17:54 user nova-compute[82184]:   <os>
Apr 12 02:17:54 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:17:54 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:17:54 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:17:54 user nova-compute[82184]:   </os>
Apr 12 02:17:54 user nova-compute[82184]:   <features>
Apr 12 02:17:54 user nova-compute[82184]:     <acpi/>
Apr 12 02:17:54 user nova-compute[82184]:     <apic/>
Apr 12 02:17:54 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:17:54 user nova-compute[82184]:   </features>
Apr 12 02:17:54 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:17:54 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:17:54 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:17:54 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:17:54 user nova-compute[82184]:   </clock>
Apr 12 02:17:54 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:17:54 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:17:54 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:17:54 user nova-compute[82184]:   </cpu>
Apr 12 02:17:54 user nova-compute[82184]:   <devices>
Apr 12 02:17:54 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:17:54 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:17:54 user nova-compute[82184]:       <source dev="/dev/sde"/>
Apr 12 02:17:54 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:17:54 user nova-compute[82184]:       <serial>452f1fa1-24b2-4afe-995f-25e0b08aa4a4</serial>
Apr 12 02:17:54 user nova-compute[82184]:     </disk>
Apr 12 02:17:54 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:17:54 user nova-compute[82184]:       <mac address="fa:16:3e:aa:30:dc"/>
Apr 12 02:17:54 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:17:54 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:17:54 user nova-compute[82184]:       <target dev="tap26028cc6-2f"/>
Apr 12 02:17:54 user nova-compute[82184]:     </interface>
Apr 12 02:17:54 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:17:54 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/7280568b-5a65-43ab-b645-605ea5652324/console.log" append="off"/>
Apr 12 02:17:54 user nova-compute[82184]:     </serial>
Apr 12 02:17:54 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:17:54 user nova-compute[82184]:     <video>
Apr 12 02:17:54 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:17:54 user nova-compute[82184]:     </video>
Apr 12 02:17:54 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:17:54 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:17:54 user nova-compute[82184]:     </rng>
Apr 12 02:17:54 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:17:54 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:17:54 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:17:54 user nova-compute[82184]:     </memballoon>
Apr 12 02:17:54 user nova-compute[82184]:   </devices>
Apr 12 02:17:54 user nova-compute[82184]: </domain>
Apr 12 02:17:54 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1832739782',display_name='tempest-TestVolumeBootPattern-server-1832739782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1832739782',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZLzl+dJPPiQ1Q3KddtYvgtfp4Cw3N4yjPTn4jGAIGgcnNkNcoYvsYhuJ1X9VE6SsNAdPUgVuioRnH9/wkBTudNIYOOGxrInu47Q267Lh/dzVGncnNeYWswwovQJnMLew==',key_name='tempest-TestVolumeBootPattern-1281564430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-qb46gjnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:17:49Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=7280568b-5a65-43ab-b645-605ea5652324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:30:dc,bridge_name='br-int',has_traffic_filtering=True,id=26028cc6-2fb8-44a6-8ecb-26e121018cc1,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26028cc6-2f') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG os_vif [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:30:dc,bridge_name='br-int',has_traffic_filtering=True,id=26028cc6-2fb8-44a6-8ecb-26e121018cc1,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26028cc6-2f') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26028cc6-2f, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26028cc6-2f, col_values=(('external_ids', {'iface-id': '26028cc6-2fb8-44a6-8ecb-26e121018cc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:30:dc', 'vm-uuid': '7280568b-5a65-43ab-b645-605ea5652324'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:17:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:55 user nova-compute[82184]: INFO os_vif [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:30:dc,bridge_name='br-int',has_traffic_filtering=True,id=26028cc6-2fb8-44a6-8ecb-26e121018cc1,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26028cc6-2f')
Apr 12 02:17:55 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:17:55 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] No VIF found with MAC fa:16:3e:aa:30:dc, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:17:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-d76bf6e7-a1d1-4193-9664-5175e4a6aa54 req-b6632b01-52ee-475a-b816-54bf08c9770f service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:17:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d76bf6e7-a1d1-4193-9664-5175e4a6aa54 req-b6632b01-52ee-475a-b816-54bf08c9770f service nova] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d76bf6e7-a1d1-4193-9664-5175e4a6aa54 req-b6632b01-52ee-475a-b816-54bf08c9770f service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d76bf6e7-a1d1-4193-9664-5175e4a6aa54 req-b6632b01-52ee-475a-b816-54bf08c9770f service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:56 user nova-compute[82184]: DEBUG nova.compute.manager [req-d76bf6e7-a1d1-4193-9664-5175e4a6aa54 req-b6632b01-52ee-475a-b816-54bf08c9770f service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] No waiting events found dispatching network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:17:56 user nova-compute[82184]: WARNING nova.compute.manager [req-d76bf6e7-a1d1-4193-9664-5175e4a6aa54 req-b6632b01-52ee-475a-b816-54bf08c9770f service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received unexpected event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 for instance with vm_state building and task_state spawning.
Apr 12 02:17:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265878.4111974, 7280568b-5a65-43ab-b645-605ea5652324 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:17:58 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7280568b-5a65-43ab-b645-605ea5652324] VM Resumed (Lifecycle Event)
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:17:58 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Instance spawned successfully.
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:17:58 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7280568b-5a65-43ab-b645-605ea5652324] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265878.4143121, 7280568b-5a65-43ab-b645-605ea5652324 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:17:58 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7280568b-5a65-43ab-b645-605ea5652324] VM Started (Lifecycle Event)
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:17:58 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7280568b-5a65-43ab-b645-605ea5652324] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:17:58 user nova-compute[82184]: INFO nova.compute.manager [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Took 4.97 seconds to spawn the instance on the hypervisor.
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-24d0e338-fae6-4902-b9c0-6811b5cbb7f0 req-577f3fc5-743e-4c38-95ef-e3b86709eab0 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-24d0e338-fae6-4902-b9c0-6811b5cbb7f0 req-577f3fc5-743e-4c38-95ef-e3b86709eab0 service nova] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-24d0e338-fae6-4902-b9c0-6811b5cbb7f0 req-577f3fc5-743e-4c38-95ef-e3b86709eab0 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-24d0e338-fae6-4902-b9c0-6811b5cbb7f0 req-577f3fc5-743e-4c38-95ef-e3b86709eab0 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:58 user nova-compute[82184]: DEBUG nova.compute.manager [req-24d0e338-fae6-4902-b9c0-6811b5cbb7f0 req-577f3fc5-743e-4c38-95ef-e3b86709eab0 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] No waiting events found dispatching network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:17:58 user nova-compute[82184]: WARNING nova.compute.manager [req-24d0e338-fae6-4902-b9c0-6811b5cbb7f0 req-577f3fc5-743e-4c38-95ef-e3b86709eab0 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received unexpected event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 for instance with vm_state building and task_state spawning.
Apr 12 02:17:58 user nova-compute[82184]: INFO nova.compute.manager [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Took 10.27 seconds to build instance.
Apr 12 02:17:58 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d48beca8-becc-44de-8e01-47c8daea423e tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "7280568b-5a65-43ab-b645-605ea5652324" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.360s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:17:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:18:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:18:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:02 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:18:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:18:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:18:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:18:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:18:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:18:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:18:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:18:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:18:03 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:18:03 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:18:03 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8460MB free_disk=26.33954620361328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:18:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:18:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e6f93d39-5be6-4223-9ac8-362ee29f9e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 8553081b-42a3-45c9-a6f6-248315547366 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 7280568b-5a65-43ab-b645-605ea5652324 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:18:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:18:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:18:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:18:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:18:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:18:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:18:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:18:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updating instance_info_cache with network_info: [{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:18:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:18:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:18:10 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:18:10 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:18:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:18:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:14 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:18:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:18:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:24 user nova-compute[82184]: DEBUG nova.compute.manager [req-f1b5d921-05c9-4ed2-ab12-425feb009e96 req-9ad4ecdc-b367-4927-9503-060fab655934 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-changed-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:18:24 user nova-compute[82184]: DEBUG nova.compute.manager [req-f1b5d921-05c9-4ed2-ab12-425feb009e96 req-9ad4ecdc-b367-4927-9503-060fab655934 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Refreshing instance network info cache due to event network-changed-2ee24eda-3ac7-48c9-b117-91371281aa33. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:18:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f1b5d921-05c9-4ed2-ab12-425feb009e96 req-9ad4ecdc-b367-4927-9503-060fab655934 service nova] Acquiring lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:18:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f1b5d921-05c9-4ed2-ab12-425feb009e96 req-9ad4ecdc-b367-4927-9503-060fab655934 service nova] Acquired lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:18:24 user nova-compute[82184]: DEBUG nova.network.neutron [req-f1b5d921-05c9-4ed2-ab12-425feb009e96 req-9ad4ecdc-b367-4927-9503-060fab655934 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Refreshing network info cache for port 2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:18:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:25 user nova-compute[82184]: DEBUG nova.network.neutron [req-f1b5d921-05c9-4ed2-ab12-425feb009e96 req-9ad4ecdc-b367-4927-9503-060fab655934 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updated VIF entry in instance network info cache for port 2ee24eda-3ac7-48c9-b117-91371281aa33. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:18:25 user nova-compute[82184]: DEBUG nova.network.neutron [req-f1b5d921-05c9-4ed2-ab12-425feb009e96 req-9ad4ecdc-b367-4927-9503-060fab655934 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating instance_info_cache with network_info: [{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:18:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f1b5d921-05c9-4ed2-ab12-425feb009e96 req-9ad4ecdc-b367-4927-9503-060fab655934 service nova] Releasing lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:18:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-f76d714e-e4f8-4329-b2d6-390b1256b8a6 req-62405f0e-5bac-4b2f-bbed-e15ae5c9528b service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-changed-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:18:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-f76d714e-e4f8-4329-b2d6-390b1256b8a6 req-62405f0e-5bac-4b2f-bbed-e15ae5c9528b service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Refreshing instance network info cache due to event network-changed-2ee24eda-3ac7-48c9-b117-91371281aa33. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:18:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f76d714e-e4f8-4329-b2d6-390b1256b8a6 req-62405f0e-5bac-4b2f-bbed-e15ae5c9528b service nova] Acquiring lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:18:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f76d714e-e4f8-4329-b2d6-390b1256b8a6 req-62405f0e-5bac-4b2f-bbed-e15ae5c9528b service nova] Acquired lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:18:25 user nova-compute[82184]: DEBUG nova.network.neutron [req-f76d714e-e4f8-4329-b2d6-390b1256b8a6 req-62405f0e-5bac-4b2f-bbed-e15ae5c9528b service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Refreshing network info cache for port 2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:18:26 user nova-compute[82184]: INFO nova.compute.manager [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Detaching volume bd53833b-60be-44d0-834d-015f87042307
Apr 12 02:18:26 user nova-compute[82184]: INFO nova.virt.block_device [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Attempting to driver detach volume bd53833b-60be-44d0-834d-015f87042307 from mountpoint /dev/vdb
Apr 12 02:18:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Attempting to detach device vdb from instance e6f93d39-5be6-4223-9ac8-362ee29f9e22 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:18:26 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:18:26 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 02:18:26 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:18:26 user nova-compute[82184]:   <serial>bd53833b-60be-44d0-834d-015f87042307</serial>
Apr 12 02:18:26 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 02:18:26 user nova-compute[82184]: </disk>
Apr 12 02:18:26 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:18:26 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Successfully detached device vdb from instance e6f93d39-5be6-4223-9ac8-362ee29f9e22 from the persistent domain config.
Apr 12 02:18:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6f93d39-5be6-4223-9ac8-362ee29f9e22 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:18:26 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:18:26 user nova-compute[82184]:   <source dev="/dev/sdc"/>
Apr 12 02:18:26 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:18:26 user nova-compute[82184]:   <serial>bd53833b-60be-44d0-834d-015f87042307</serial>
Apr 12 02:18:26 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 02:18:26 user nova-compute[82184]: </disk>
Apr 12 02:18:26 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG nova.network.neutron [req-f76d714e-e4f8-4329-b2d6-390b1256b8a6 req-62405f0e-5bac-4b2f-bbed-e15ae5c9528b service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updated VIF entry in instance network info cache for port 2ee24eda-3ac7-48c9-b117-91371281aa33. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG nova.network.neutron [req-f76d714e-e4f8-4329-b2d6-390b1256b8a6 req-62405f0e-5bac-4b2f-bbed-e15ae5c9528b service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating instance_info_cache with network_info: [{"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f76d714e-e4f8-4329-b2d6-390b1256b8a6 req-62405f0e-5bac-4b2f-bbed-e15ae5c9528b service nova] Releasing lock "refresh_cache-e6f93d39-5be6-4223-9ac8-362ee29f9e22" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681265906.7566915, e6f93d39-5be6-4223-9ac8-362ee29f9e22 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:18:26 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Successfully detached device vdb from instance e6f93d39-5be6-4223-9ac8-362ee29f9e22 from the live domain config.
Apr 12 02:18:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzeDjbws', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:18:26 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[48901129-b213-42dc-9781-cdf7a11549cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:18:26 user nova-compute[82184]: No targets found.
Apr 12 02:18:26 user nova-compute[82184]: iSNS:
Apr 12 02:18:26 user nova-compute[82184]: No targets found.
Apr 12 02:18:26 user nova-compute[82184]: STATIC:
Apr 12 02:18:26 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4
Apr 12 02:18:26 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:18:26 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:18:26 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34
Apr 12 02:18:26 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:18:26 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:18:26 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5
Apr 12 02:18:26 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:18:26 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:18:26 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307
Apr 12 02:18:26 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:18:26 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:18:26 user nova-compute[82184]: FIRMWARE:
Apr 12 02:18:26 user nova-compute[82184]: No targets found.
Apr 12 02:18:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:18:26 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:18:26 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[df07bedb-1e5a-405f-959f-db994778aede]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93507ea-2dcd-4a3b-bffe-d560821a4650]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:18:26 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:18:26 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:18:26 user nova-compute[82184]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)
Apr 12 02:18:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:18:26 user nova-compute[82184]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 (non-flash)
Apr 12 02:18:26 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:18:26 user nova-compute[82184]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)
Apr 12 02:18:26 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a87af010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307'): ({'sdc'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Removing single pathed devices sdc {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1838c8c2-9947-48fd-ad2e-e95fcc3812b5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[03561c0a-ee36-4b7c-8bcb-fc85a80bade6]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Flushing IO for device /dev/sdc {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[79476608-ff9e-44e0-be35-97efdd903ee8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01739fc-7851-4825-91bf-10e137855026]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] SCSI volumes sdc have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bc6dcf-35ef-4de0-b73f-bdc5fb517d5e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:18:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb959e30-53ed-4a1a-a6c3-b28283252a0e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260]
Apr 12 02:18:27 user nova-compute[82184]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307, portal: 172.16.0.220,3260] successful.
Apr 12 02:18:27 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd53833b-60be-44d0-834d-015f87042307 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[984d647e-0dc3-495e-b31e-97a8db798885]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] <== disconnect_volume: return (312ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG nova.objects.instance [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'flavor' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:18:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-d2a02da1-2b26-4093-8de6-78abb4438263 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.685s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:18:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:18:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:18:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:19:02 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:19:02 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:19:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:02 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:19:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:19:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:19:02 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:19:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:03 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:19:03 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:19:03 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8484MB free_disk=26.338550567626953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:19:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e6f93d39-5be6-4223-9ac8-362ee29f9e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 8553081b-42a3-45c9-a6f6-248315547366 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 7280568b-5a65-43ab-b645-605ea5652324 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:19:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:19:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:19:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:19:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:19:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:19:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:19:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:19:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updating instance_info_cache with network_info: [{"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:19:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:19:10 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:19:10 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:19:10 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:19:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:19:14 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:19:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:19:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:19:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:18 user nova-compute[82184]: INFO nova.compute.manager [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Terminating instance
Apr 12 02:19:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:19:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-9f021dbf-f22e-43c8-ac6c-12fefbc6c9b1 req-85cebfb0-4862-47c4-9465-6047c3b4d1a2 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-vif-unplugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9f021dbf-f22e-43c8-ac6c-12fefbc6c9b1 req-85cebfb0-4862-47c4-9465-6047c3b4d1a2 service nova] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9f021dbf-f22e-43c8-ac6c-12fefbc6c9b1 req-85cebfb0-4862-47c4-9465-6047c3b4d1a2 service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9f021dbf-f22e-43c8-ac6c-12fefbc6c9b1 req-85cebfb0-4862-47c4-9465-6047c3b4d1a2 service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-9f021dbf-f22e-43c8-ac6c-12fefbc6c9b1 req-85cebfb0-4862-47c4-9465-6047c3b4d1a2 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] No waiting events found dispatching network-vif-unplugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-9f021dbf-f22e-43c8-ac6c-12fefbc6c9b1 req-85cebfb0-4862-47c4-9465-6047c3b4d1a2 service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-vif-unplugged-2ee24eda-3ac7-48c9-b117-91371281aa33 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:19:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Instance destroyed successfully.
Apr 12 02:19:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'resources' on Instance uuid e6f93d39-5be6-4223-9ac8-362ee29f9e22 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1897008155',display_name='tempest-TestMinimumBasicScenario-server-1897008155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1897008155',id=36,image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9jZCWKV6hxux1R3+C+7uefGfjpgPqW32T2YiNnkme9UOOl4uU3OGWAWXACSx7haDpHOtbD7cTM7r65siGiAgj09hq/+hBvt2qQXd3ZpwfsOyduBx4iSrwxw2ZDVRKj2g==',key_name='tempest-TestMinimumBasicScenario-1687627615',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:14:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b73a0cde174feeb85558cebb13d137',ramdisk_id='',reservation_id='r-gyd5dlif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='844b59ea-88c3-4180-bac8-c8fed5694334',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-934200257',owner_user_name='tempest-TestMinimumBasicScenario-934200257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:16:40Z,user_data=None,user_id='88570fbc28654337a032da5fa1f58814',uuid=e6f93d39-5be6-4223-9ac8-362ee29f9e22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converting VIF {"id": "2ee24eda-3ac7-48c9-b117-91371281aa33", "address": "fa:16:3e:98:2c:6a", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee24eda-3a", "ovs_interfaceid": "2ee24eda-3ac7-48c9-b117-91371281aa33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG os_vif [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ee24eda-3a, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:19:19 user nova-compute[82184]: INFO os_vif [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:2c:6a,bridge_name='br-int',has_traffic_filtering=True,id=2ee24eda-3ac7-48c9-b117-91371281aa33,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee24eda-3a')
Apr 12 02:19:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Deleting instance files /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22_del
Apr 12 02:19:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Deletion of /opt/stack/data/nova/instances/e6f93d39-5be6-4223-9ac8-362ee29f9e22_del complete
Apr 12 02:19:19 user nova-compute[82184]: INFO nova.compute.manager [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 02:19:19 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:19:19 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:19:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:20 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:19:20 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Took 0.47 seconds to deallocate network for instance.
Apr 12 02:19:20 user nova-compute[82184]: DEBUG nova.compute.manager [req-384cce81-6206-496e-b8cc-b2d6bc23ef7e req-98fd91c1-381c-47d0-8ea6-d839e8d4d76c service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-vif-deleted-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:20 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:19:20 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:19:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:20 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Deleted allocations for instance e6f93d39-5be6-4223-9ac8-362ee29f9e22
Apr 12 02:19:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-de49922b-96e2-49d8-ae12-cf1d8b429465 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.753s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-721140f5-3759-41f5-b64e-3002bbf7229c req-f993662a-72fd-4566-8ca8-8f36de58856a service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-721140f5-3759-41f5-b64e-3002bbf7229c req-f993662a-72fd-4566-8ca8-8f36de58856a service nova] Acquiring lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-721140f5-3759-41f5-b64e-3002bbf7229c req-f993662a-72fd-4566-8ca8-8f36de58856a service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-721140f5-3759-41f5-b64e-3002bbf7229c req-f993662a-72fd-4566-8ca8-8f36de58856a service nova] Lock "e6f93d39-5be6-4223-9ac8-362ee29f9e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-721140f5-3759-41f5-b64e-3002bbf7229c req-f993662a-72fd-4566-8ca8-8f36de58856a service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] No waiting events found dispatching network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:21 user nova-compute[82184]: WARNING nova.compute.manager [req-721140f5-3759-41f5-b64e-3002bbf7229c req-f993662a-72fd-4566-8ca8-8f36de58856a service nova] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Received unexpected event network-vif-plugged-2ee24eda-3ac7-48c9-b117-91371281aa33 for instance with vm_state deleted and task_state None.
Apr 12 02:19:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:28 user nova-compute[82184]: INFO nova.compute.manager [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Rescuing
Apr 12 02:19:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:19:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquired lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:19:28 user nova-compute[82184]: DEBUG nova.network.neutron [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:19:28 user nova-compute[82184]: DEBUG nova.network.neutron [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updating instance_info_cache with network_info: [{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:19:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Releasing lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:19:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-3822dd1a-89fb-45b2-b6f0-cea46930f34d req-de252e75-ef5c-4ffb-a674-483a849beae3 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-unplugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3822dd1a-89fb-45b2-b6f0-cea46930f34d req-de252e75-ef5c-4ffb-a674-483a849beae3 service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3822dd1a-89fb-45b2-b6f0-cea46930f34d req-de252e75-ef5c-4ffb-a674-483a849beae3 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3822dd1a-89fb-45b2-b6f0-cea46930f34d req-de252e75-ef5c-4ffb-a674-483a849beae3 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-3822dd1a-89fb-45b2-b6f0-cea46930f34d req-de252e75-ef5c-4ffb-a674-483a849beae3 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-unplugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:29 user nova-compute[82184]: WARNING nova.compute.manager [req-3822dd1a-89fb-45b2-b6f0-cea46930f34d req-de252e75-ef5c-4ffb-a674-483a849beae3 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-unplugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state active and task_state rescuing.
Apr 12 02:19:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:29 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Instance destroyed successfully.
Apr 12 02:19:29 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Attempting a stable device rescue
Apr 12 02:19:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Instance directory exists: not creating {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 02:19:29 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Creating image(s)
Apr 12 02:19:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "/opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "/opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "/opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'trusted_certs' on Instance uuid 811c4fb7-d984-461e-9190-4d0e9ec345c2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "8418b8183a766d5e1140be654e99d292e93a0493" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "8418b8183a766d5e1140be654e99d292e93a0493" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493.part --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493.part --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:30 user nova-compute[82184]: DEBUG nova.virt.images [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] fea148e9-4d9a-4c1c-9836-28e2777cc93e was qcow2, converting to raw {{(pid=82184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 02:19:30 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:19:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493.part /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493.converted {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493.part /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493.converted" returned: 0 in 0.382s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493.converted --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "8418b8183a766d5e1140be654e99d292e93a0493" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.405s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "8418b8183a766d5e1140be654e99d292e93a0493" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "8418b8183a766d5e1140be654e99d292e93a0493" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-dc122366-2de2-42a9-be1e-cc95b311ba47 req-e301e6c8-09e8-4adb-bde0-c17b1c18b1d6 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-dc122366-2de2-42a9-be1e-cc95b311ba47 req-e301e6c8-09e8-4adb-bde0-c17b1c18b1d6 service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-dc122366-2de2-42a9-be1e-cc95b311ba47 req-e301e6c8-09e8-4adb-bde0-c17b1c18b1d6 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-dc122366-2de2-42a9-be1e-cc95b311ba47 req-e301e6c8-09e8-4adb-bde0-c17b1c18b1d6 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.compute.manager [req-dc122366-2de2-42a9-be1e-cc95b311ba47 req-e301e6c8-09e8-4adb-bde0-c17b1c18b1d6 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:31 user nova-compute[82184]: WARNING nova.compute.manager [req-dc122366-2de2-42a9-be1e-cc95b311ba47 req-e301e6c8-09e8-4adb-bde0-c17b1c18b1d6 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state active and task_state rescuing.
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493 --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493,backing_fmt=raw /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493,backing_fmt=raw /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue" returned: 0 in 0.046s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "8418b8183a766d5e1140be654e99d292e93a0493" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'migration_context' on Instance uuid 811c4fb7-d984-461e-9190-4d0e9ec345c2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Start _get_guest_xml network_info=[{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "vif_mac": "fa:16:3e:47:c2:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fea148e9-4d9a-4c1c-9836-28e2777cc93e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': 'e6f594af-5a63-43df-9f98-aac9b8ce0a7b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDcoqanN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '811c4fb7-d984-461e-9190-4d0e9ec345c2', 'attached_at': '', 'detached_at': '', 'volume_id': '774cf9c9-daf1-4a88-8b14-008fd044bf34', 'serial': '774cf9c9-daf1-4a88-8b14-008fd044bf34'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'resources' on Instance uuid 811c4fb7-d984-461e-9190-4d0e9ec345c2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'numa_topology' on Instance uuid 811c4fb7-d984-461e-9190-4d0e9ec345c2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:19:31 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:19:31 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'vcpu_model' on Instance uuid 811c4fb7-d984-461e-9190-4d0e9ec345c2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDcoqanN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:19:31 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:19:31 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:19:31 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[380dc1c4-86b3-49d8-b085-a781fe645f2b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = UDcoqanN\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 02:19:31 user nova-compute[82184]: node.name = iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34
Apr 12 02:19:31 user nova-compute[82184]: node.tpgt = -1
Apr 12 02:19:31 user nova-compute[82184]: node.startup = automatic
Apr 12 02:19:31 user nova-compute[82184]: node.leading_login = No
Apr 12 02:19:31 user nova-compute[82184]: iface.iscsi_ifacename = default
Apr 12 02:19:31 user nova-compute[82184]: iface.net_ifacename = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.ipaddress = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.prefix_len = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.hwaddress = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.transport_name = tcp
Apr 12 02:19:31 user nova-compute[82184]: iface.initiatorname = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.state = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.vlan_id = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.vlan_priority = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.vlan_state = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.iface_num = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.mtu = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.port = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.bootproto = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.subnet_mask = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.gateway = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.dhcp_alt_client_id = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.dhcp_dns = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.dhcp_learn_iqn = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.dhcp_vendor_id_state = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.dhcp_vendor_id = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.dhcp_slp_da = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.fragmentation = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.gratuitous_arp = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.incoming_forwarding = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.tos_state = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.tos = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.ttl = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.delayed_ack = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.tcp_nagle = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.tcp_wsf_state = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.tcp_wsf = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.tcp_timer_scale = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.tcp_timestamp = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.redirect = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.def_task_mgmt_timeout = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.header_digest = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.data_digest = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.immediate_data = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.initial_r2t = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.data_seq_inorder = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.data_pdu_inorder = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.erl = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.max_receive_data_len = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.first_burst_len = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.max_outstanding_r2t = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.max_burst_len = 0
Apr 12 02:19:31 user nova-compute[82184]: iface.chap_auth = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.bidi_chap = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.strict_login_compliance = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.discovery_auth = <empty>
Apr 12 02:19:31 user nova-compute[82184]: iface.discovery_logout = <empty>
Apr 12 02:19:31 user nova-compute[82184]: node.discovery_address = <empty>
Apr 12 02:19:31 user nova-compute[82184]: node.discovery_port = 0
Apr 12 02:19:31 user nova-compute[82184]: node.discovery_type = static
Apr 12 02:19:31 user nova-compute[82184]: node.session.initial_cmdsn = 0
Apr 12 02:19:31 user nova-compute[82184]: node.session.initial_login_retry_max = 8
Apr 12 02:19:31 user nova-compute[82184]: node.session.xmit_thread_priority = -20
Apr 12 02:19:31 user nova-compute[82184]: node.session.cmds_max = 128
Apr 12 02:19:31 user nova-compute[82184]: node.session.queue_depth = 32
Apr 12 02:19:31 user nova-compute[82184]: node.session.nr_sessions = 1
Apr 12 02:19:31 user nova-compute[82184]: node.session.auth.authmethod = CHAP
Apr 12 02:19:31 user nova-compute[82184]: node.session.auth.username = UDcoqanN
Apr 12 02:19:31 user nova-compute[82184]: node.session.auth.password = ***
Apr 12 02:19:31 user nova-compute[82184]: node.session.auth.username_in = <empty>
Apr 12 02:19:31 user nova-compute[82184]: node.session.auth.password_in = <empty>
Apr 12 02:19:31 user nova-compute[82184]: node.session.auth.chap_algs = MD5
Apr 12 02:19:31 user nova-compute[82184]: node.session.timeo.replacement_timeout = 120
Apr 12 02:19:31 user nova-compute[82184]: node.session.err_timeo.abort_timeout = 15
Apr 12 02:19:31 user nova-compute[82184]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 02:19:31 user nova-compute[82184]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 02:19:31 user nova-compute[82184]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 02:19:31 user nova-compute[82184]: node.session.iscsi.FastAbort = Yes
Apr 12 02:19:31 user nova-compute[82184]: node.session.iscsi.InitialR2T = No
Apr 12 02:19:31 user nova-compute[82184]: node.session.iscsi.ImmediateData = Yes
Apr 12 02:19:31 user nova-compute[82184]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 02:19:31 user nova-compute[82184]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 02:19:31 user nova-compute[82184]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 02:19:31 user nova-compute[82184]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 02:19:31 user nova-compute[82184]: node.session.iscsi.MaxConnections = 1
Apr 12 02:19:31 user nova-compute[82184]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 02:19:31 user nova-compute[82184]: node.session.iscsi.ERL = 0
Apr 12 02:19:31 user nova-compute[82184]: node.session.scan = manual
Apr 12 02:19:31 user nova-compute[82184]: node.session.reopen_max = 0
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].address = 172.16.0.220
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].port = 3260
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].startup = manual
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].tcp.window_size = 524288
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].tcp.type_of_service = 0
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].timeo.logout_timeout = 15
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].timeo.login_timeout = 15
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].timeo.auth_timeout = 45
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].iscsi.DataDigest = None
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].iscsi.IFMarker = No
Apr 12 02:19:31 user nova-compute[82184]: node.conn[0].iscsi.OFMarker = No
Apr 12 02:19:31 user nova-compute[82184]: # END RECORD
Apr 12 02:19:31 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edb49f0-2904-4ae8-b851-0886be6cc133]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[27307361-de72-41b3-8933-81d18a5aa67d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UDcoqanN {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UDcoqanN" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a5fc28-aca0-4a80-a6e6-4cbba081941f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UDcoqanN'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f028684-0e42-4250-be4f-2397c075327f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[989f177a-def3-46bb-ba8f-c766d83cfd54]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:19:31 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:19:31 user nova-compute[82184]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)
Apr 12 02:19:31 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:19:31 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:19:31 user nova-compute[82184]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)
Apr 12 02:19:31 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] HCTL ('35', '0', '0', 0) found on session 47 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[88416d31-8611-4598-a3ae-cb4b742823c5]: (4, ('0 0 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Searching for a device in session 47 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDcoqanN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.168s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '23639626165373932', 'path': '/dev/sdd'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639626165373932', 'path': '/dev/sdd'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839044150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839044150',id=39,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:17:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-a1daltq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:17:53Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=811c4fb7-d984-461e-9190-4d0e9ec345c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "vif_mac": "fa:16:3e:47:c2:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "vif_mac": "fa:16:3e:47:c2:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=217714fd-b1ef-4cf0-8f00-ec948d907b1b,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217714fd-b1') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.objects.instance [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'pci_devices' on Instance uuid 811c4fb7-d984-461e-9190-4d0e9ec345c2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:19:31 user nova-compute[82184]:   <uuid>811c4fb7-d984-461e-9190-4d0e9ec345c2</uuid>
Apr 12 02:19:31 user nova-compute[82184]:   <name>instance-00000027</name>
Apr 12 02:19:31 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:19:31 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:19:31 user nova-compute[82184]:   <metadata>
Apr 12 02:19:31 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:19:31 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:19:31 user nova-compute[82184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1839044150</nova:name>
Apr 12 02:19:31 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:19:31</nova:creationTime>
Apr 12 02:19:31 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:19:31 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:19:31 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:19:31 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:19:31 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:19:31 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:19:31 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:19:31 user nova-compute[82184]:       <nova:owner>
Apr 12 02:19:31 user nova-compute[82184]:         <nova:user uuid="fe9217f4c1ff428086140b7fd07194eb">tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member</nova:user>
Apr 12 02:19:31 user nova-compute[82184]:         <nova:project uuid="6bb951049b464316a04647ce9c52963a">tempest-ServerBootFromVolumeStableRescueTest-1070279577</nova:project>
Apr 12 02:19:31 user nova-compute[82184]:       </nova:owner>
Apr 12 02:19:31 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:19:31 user nova-compute[82184]:       <nova:ports>
Apr 12 02:19:31 user nova-compute[82184]:         <nova:port uuid="217714fd-b1ef-4cf0-8f00-ec948d907b1b">
Apr 12 02:19:31 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 02:19:31 user nova-compute[82184]:         </nova:port>
Apr 12 02:19:31 user nova-compute[82184]:       </nova:ports>
Apr 12 02:19:31 user nova-compute[82184]:     </nova:instance>
Apr 12 02:19:31 user nova-compute[82184]:   </metadata>
Apr 12 02:19:31 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:19:31 user nova-compute[82184]:     <system>
Apr 12 02:19:31 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:19:31 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:19:31 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:19:31 user nova-compute[82184]:       <entry name="serial">811c4fb7-d984-461e-9190-4d0e9ec345c2</entry>
Apr 12 02:19:31 user nova-compute[82184]:       <entry name="uuid">811c4fb7-d984-461e-9190-4d0e9ec345c2</entry>
Apr 12 02:19:31 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:19:31 user nova-compute[82184]:     </system>
Apr 12 02:19:31 user nova-compute[82184]:   </sysinfo>
Apr 12 02:19:31 user nova-compute[82184]:   <os>
Apr 12 02:19:31 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:19:31 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:19:31 user nova-compute[82184]:   </os>
Apr 12 02:19:31 user nova-compute[82184]:   <features>
Apr 12 02:19:31 user nova-compute[82184]:     <acpi/>
Apr 12 02:19:31 user nova-compute[82184]:     <apic/>
Apr 12 02:19:31 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:19:31 user nova-compute[82184]:   </features>
Apr 12 02:19:31 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:19:31 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:19:31 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:19:31 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:19:31 user nova-compute[82184]:   </clock>
Apr 12 02:19:31 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:19:31 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:19:31 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:19:31 user nova-compute[82184]:   </cpu>
Apr 12 02:19:31 user nova-compute[82184]:   <devices>
Apr 12 02:19:31 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:19:31 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:19:31 user nova-compute[82184]:       <source dev="/dev/sdd"/>
Apr 12 02:19:31 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:19:31 user nova-compute[82184]:       <serial>774cf9c9-daf1-4a88-8b14-008fd044bf34</serial>
Apr 12 02:19:31 user nova-compute[82184]:     </disk>
Apr 12 02:19:31 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:19:31 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:19:31 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue"/>
Apr 12 02:19:31 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 02:19:31 user nova-compute[82184]:       <boot order="1"/>
Apr 12 02:19:31 user nova-compute[82184]:     </disk>
Apr 12 02:19:31 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:19:31 user nova-compute[82184]:       <mac address="fa:16:3e:47:c2:75"/>
Apr 12 02:19:31 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:19:31 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:19:31 user nova-compute[82184]:       <target dev="tap217714fd-b1"/>
Apr 12 02:19:31 user nova-compute[82184]:     </interface>
Apr 12 02:19:31 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:19:31 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/console.log" append="off"/>
Apr 12 02:19:31 user nova-compute[82184]:     </serial>
Apr 12 02:19:31 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:19:31 user nova-compute[82184]:     <video>
Apr 12 02:19:31 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:19:31 user nova-compute[82184]:     </video>
Apr 12 02:19:31 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:19:31 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:19:31 user nova-compute[82184]:     </rng>
Apr 12 02:19:31 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:19:31 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:19:31 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:19:31 user nova-compute[82184]:     </memballoon>
Apr 12 02:19:31 user nova-compute[82184]:   </devices>
Apr 12 02:19:31 user nova-compute[82184]: </domain>
Apr 12 02:19:31 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:19:31 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Instance destroyed successfully.
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:19:31 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No VIF found with MAC fa:16:3e:47:c2:75, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:19:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-53e89305-7f79-4936-8548-5ff128106b4e req-e1b41e61-bf3e-4db1-a062-1d18c91a9561 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53e89305-7f79-4936-8548-5ff128106b4e req-e1b41e61-bf3e-4db1-a062-1d18c91a9561 service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53e89305-7f79-4936-8548-5ff128106b4e req-e1b41e61-bf3e-4db1-a062-1d18c91a9561 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-53e89305-7f79-4936-8548-5ff128106b4e req-e1b41e61-bf3e-4db1-a062-1d18c91a9561 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-53e89305-7f79-4936-8548-5ff128106b4e req-e1b41e61-bf3e-4db1-a062-1d18c91a9561 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:33 user nova-compute[82184]: WARNING nova.compute.manager [req-53e89305-7f79-4936-8548-5ff128106b4e req-e1b41e61-bf3e-4db1-a062-1d18c91a9561 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state active and task_state rescuing.
Apr 12 02:19:34 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265959.5991595, e6f93d39-5be6-4223-9ac8-362ee29f9e22 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:19:34 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] VM Stopped (Lifecycle Event)
Apr 12 02:19:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5b89f5a3-4ce2-43b0-8b31-72d249953a60 None None] [instance: e6f93d39-5be6-4223-9ac8-362ee29f9e22] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:19:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for 811c4fb7-d984-461e-9190-4d0e9ec345c2 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 02:19:35 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265975.0835595, 811c4fb7-d984-461e-9190-4d0e9ec345c2 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:19:35 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] VM Resumed (Lifecycle Event)
Apr 12 02:19:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-a0c9158f-8f98-405b-932a-1fe3f45f2d15 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:19:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:19:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:19:35 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 02:19:35 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681265975.0844946, 811c4fb7-d984-461e-9190-4d0e9ec345c2 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:19:35 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] VM Started (Lifecycle Event)
Apr 12 02:19:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:19:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:19:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-515d86c6-13a6-4a82-9943-f7d4ff4e04cc req-b190f95a-4576-48ee-ab76-4f8048b476ad service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-515d86c6-13a6-4a82-9943-f7d4ff4e04cc req-b190f95a-4576-48ee-ab76-4f8048b476ad service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-515d86c6-13a6-4a82-9943-f7d4ff4e04cc req-b190f95a-4576-48ee-ab76-4f8048b476ad service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-515d86c6-13a6-4a82-9943-f7d4ff4e04cc req-b190f95a-4576-48ee-ab76-4f8048b476ad service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-515d86c6-13a6-4a82-9943-f7d4ff4e04cc req-b190f95a-4576-48ee-ab76-4f8048b476ad service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:35 user nova-compute[82184]: WARNING nova.compute.manager [req-515d86c6-13a6-4a82-9943-f7d4ff4e04cc req-b190f95a-4576-48ee-ab76-4f8048b476ad service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state rescued and task_state None.
Apr 12 02:19:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-3f0c123d-724c-4dcc-81d2-936a922a2f53 req-7473c943-37dc-4cbb-b97c-05ce8a215e24 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-changed-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-3f0c123d-724c-4dcc-81d2-936a922a2f53 req-7473c943-37dc-4cbb-b97c-05ce8a215e24 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Refreshing instance network info cache due to event network-changed-26028cc6-2fb8-44a6-8ecb-26e121018cc1. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3f0c123d-724c-4dcc-81d2-936a922a2f53 req-7473c943-37dc-4cbb-b97c-05ce8a215e24 service nova] Acquiring lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3f0c123d-724c-4dcc-81d2-936a922a2f53 req-7473c943-37dc-4cbb-b97c-05ce8a215e24 service nova] Acquired lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG nova.network.neutron [req-3f0c123d-724c-4dcc-81d2-936a922a2f53 req-7473c943-37dc-4cbb-b97c-05ce8a215e24 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Refreshing network info cache for port 26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG nova.network.neutron [req-3f0c123d-724c-4dcc-81d2-936a922a2f53 req-7473c943-37dc-4cbb-b97c-05ce8a215e24 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Updated VIF entry in instance network info cache for port 26028cc6-2fb8-44a6-8ecb-26e121018cc1. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG nova.network.neutron [req-3f0c123d-724c-4dcc-81d2-936a922a2f53 req-7473c943-37dc-4cbb-b97c-05ce8a215e24 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Updating instance_info_cache with network_info: [{"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3f0c123d-724c-4dcc-81d2-936a922a2f53 req-7473c943-37dc-4cbb-b97c-05ce8a215e24 service nova] Releasing lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-a68ed19d-200d-4ac5-a44c-1a92970b097d req-12c1832e-7d3e-44e8-bf54-47ee979b0d38 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-changed-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-a68ed19d-200d-4ac5-a44c-1a92970b097d req-12c1832e-7d3e-44e8-bf54-47ee979b0d38 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Refreshing instance network info cache due to event network-changed-26028cc6-2fb8-44a6-8ecb-26e121018cc1. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a68ed19d-200d-4ac5-a44c-1a92970b097d req-12c1832e-7d3e-44e8-bf54-47ee979b0d38 service nova] Acquiring lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a68ed19d-200d-4ac5-a44c-1a92970b097d req-12c1832e-7d3e-44e8-bf54-47ee979b0d38 service nova] Acquired lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG nova.network.neutron [req-a68ed19d-200d-4ac5-a44c-1a92970b097d req-12c1832e-7d3e-44e8-bf54-47ee979b0d38 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Refreshing network info cache for port 26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "7280568b-5a65-43ab-b645-605ea5652324" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:40 user nova-compute[82184]: INFO nova.compute.manager [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Terminating instance
Apr 12 02:19:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:19:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG nova.network.neutron [req-a68ed19d-200d-4ac5-a44c-1a92970b097d req-12c1832e-7d3e-44e8-bf54-47ee979b0d38 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Updated VIF entry in instance network info cache for port 26028cc6-2fb8-44a6-8ecb-26e121018cc1. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG nova.network.neutron [req-a68ed19d-200d-4ac5-a44c-1a92970b097d req-12c1832e-7d3e-44e8-bf54-47ee979b0d38 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Updating instance_info_cache with network_info: [{"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a68ed19d-200d-4ac5-a44c-1a92970b097d req-12c1832e-7d3e-44e8-bf54-47ee979b0d38 service nova] Releasing lock "refresh_cache-7280568b-5a65-43ab-b645-605ea5652324" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Instance destroyed successfully.
Apr 12 02:19:41 user nova-compute[82184]: DEBUG nova.objects.instance [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'resources' on Instance uuid 7280568b-5a65-43ab-b645-605ea5652324 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:17:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1832739782',display_name='tempest-TestVolumeBootPattern-server-1832739782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1832739782',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZLzl+dJPPiQ1Q3KddtYvgtfp4Cw3N4yjPTn4jGAIGgcnNkNcoYvsYhuJ1X9VE6SsNAdPUgVuioRnH9/wkBTudNIYOOGxrInu47Q267Lh/dzVGncnNeYWswwovQJnMLew==',key_name='tempest-TestVolumeBootPattern-1281564430',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-qb46gjnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:17:59Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=7280568b-5a65-43ab-b645-605ea5652324,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "address": "fa:16:3e:aa:30:dc", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26028cc6-2f", "ovs_interfaceid": "26028cc6-2fb8-44a6-8ecb-26e121018cc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:30:dc,bridge_name='br-int',has_traffic_filtering=True,id=26028cc6-2fb8-44a6-8ecb-26e121018cc1,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26028cc6-2f') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_vif [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:30:dc,bridge_name='br-int',has_traffic_filtering=True,id=26028cc6-2fb8-44a6-8ecb-26e121018cc1,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26028cc6-2f') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26028cc6-2f, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: INFO os_vif [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:30:dc,bridge_name='br-int',has_traffic_filtering=True,id=26028cc6-2fb8-44a6-8ecb-26e121018cc1,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26028cc6-2f')
Apr 12 02:19:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNactjzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:19:41 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[771f3ad1-1712-4b6d-8c5e-92470fed40e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:19:41 user nova-compute[82184]: No targets found.
Apr 12 02:19:41 user nova-compute[82184]: iSNS:
Apr 12 02:19:41 user nova-compute[82184]: No targets found.
Apr 12 02:19:41 user nova-compute[82184]: STATIC:
Apr 12 02:19:41 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4
Apr 12 02:19:41 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:19:41 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:19:41 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34
Apr 12 02:19:41 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:19:41 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:19:41 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5
Apr 12 02:19:41 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:19:41 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:19:41 user nova-compute[82184]: FIRMWARE:
Apr 12 02:19:41 user nova-compute[82184]: No targets found.
Apr 12 02:19:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:19:41 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:19:41 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d287eb11-d712-484b-8cfe-a402d4080771]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f947aed-15fd-4fb9-b4d2-75ebae86280f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:19:41 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:19:41 user nova-compute[82184]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)
Apr 12 02:19:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:19:41 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:19:41 user nova-compute[82184]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 (non-flash)
Apr 12 02:19:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a83763b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4'): ({'sde'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Removing single pathed devices sde {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c1503-9036-4b74-8b1c-adece093b446]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5e6736-8307-40e1-b87d-cbf6b45dba30]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flushing IO for device /dev/sde {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9e4a87-0ec1-4568-8bc5-022179b13952]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[304359c8-42fd-499c-b770-304bbb6ca2a3]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] SCSI volumes sde have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c71d5d5-92ae-4a88-8ca9-23206ce59679]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c58d481-ab3b-4f7b-b923-0ff012944717]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4, portal: 172.16.0.220,3260]
Apr 12 02:19:41 user nova-compute[82184]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4, portal: 172.16.0.220,3260] successful.
Apr 12 02:19:41 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:19:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:452f1fa1-24b2-4afe-995f-25e0b08aa4a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0138a7-b43a-4373-b36a-e269352661fe]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== disconnect_volume: return (326ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:19:42 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Deleting instance files /opt/stack/data/nova/instances/7280568b-5a65-43ab-b645-605ea5652324_del
Apr 12 02:19:42 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Deletion of /opt/stack/data/nova/instances/7280568b-5a65-43ab-b645-605ea5652324_del complete
Apr 12 02:19:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:42 user nova-compute[82184]: INFO nova.compute.manager [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 7280568b-5a65-43ab-b645-605ea5652324] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-vif-unplugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] No waiting events found dispatching network-vif-unplugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-vif-unplugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] No waiting events found dispatching network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:42 user nova-compute[82184]: WARNING nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received unexpected event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 for instance with vm_state active and task_state deleting.
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] No waiting events found dispatching network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:42 user nova-compute[82184]: WARNING nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received unexpected event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 for instance with vm_state active and task_state deleting.
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] No waiting events found dispatching network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:42 user nova-compute[82184]: WARNING nova.compute.manager [req-a98afb7b-bcc6-44ab-b84d-040e2fe573f4 req-a74ab2b8-431a-42dd-98bb-5f89b9ab1577 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received unexpected event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 for instance with vm_state active and task_state deleting.
Apr 12 02:19:43 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:19:43 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Took 1.02 seconds to deallocate network for instance.
Apr 12 02:19:43 user nova-compute[82184]: INFO nova.compute.manager [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Took 0.82 seconds to detach 1 volumes for instance.
Apr 12 02:19:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:44 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Deleted allocations for instance 7280568b-5a65-43ab-b645-605ea5652324
Apr 12 02:19:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-vif-unplugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] No waiting events found dispatching network-vif-unplugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:44 user nova-compute[82184]: WARNING nova.compute.manager [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received unexpected event network-vif-unplugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 for instance with vm_state deleted and task_state None.
Apr 12 02:19:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] Acquiring lock "7280568b-5a65-43ab-b645-605ea5652324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] Lock "7280568b-5a65-43ab-b645-605ea5652324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] No waiting events found dispatching network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:19:44 user nova-compute[82184]: WARNING nova.compute.manager [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received unexpected event network-vif-plugged-26028cc6-2fb8-44a6-8ecb-26e121018cc1 for instance with vm_state deleted and task_state None.
Apr 12 02:19:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-fcac2dc9-fa0e-4063-98c3-349b102584e5 req-6feab767-2fa6-4717-849a-25a2acd62980 service nova] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Received event network-vif-deleted-26028cc6-2fb8-44a6-8ecb-26e121018cc1 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:19:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-657dfa3b-2a04-45cd-a33e-3dceece32e42 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "7280568b-5a65-43ab-b645-605ea5652324" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.404s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:19:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:56 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681265981.625968, 7280568b-5a65-43ab-b645-605ea5652324 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:19:56 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 7280568b-5a65-43ab-b645-605ea5652324] VM Stopped (Lifecycle Event)
Apr 12 02:19:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6040e61b-61b9-44e3-8b63-fe724e4d62f7 None None] [instance: 7280568b-5a65-43ab-b645-605ea5652324] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:19:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:19:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:20:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:20:04 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:20:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:04 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:20:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:20:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:20:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:05 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:20:05 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:20:05 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8481MB free_disk=26.286579132080078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 8553081b-42a3-45c9-a6f6-248315547366 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:20:05 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:20:06 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:20:06 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:20:06 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:20:06 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 3036c0b5-7987-4ff5-9edf-ee7397cf7beb {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updating instance_info_cache with network_info: [{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:20:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:20:10 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:20:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:20:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:20:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:20:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:20:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:20:12 user nova-compute[82184]: INFO nova.compute.claims [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Claim successful on node user
Apr 12 02:20:12 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:20:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:20:13 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:20:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG nova.policy [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88570fbc28654337a032da5fa1f58814', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b73a0cde174feeb85558cebb13d137', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:20:13 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Creating image(s)
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "/opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "/opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "05066d1209cdc5effee2113fba12d887d85fd1e0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "05066d1209cdc5effee2113fba12d887d85fd1e0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0.part --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0.part --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG nova.virt.images [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] b6ae0cea-7c74-495d-ae4c-3c01f51c692e was qcow2, converting to raw {{(pid=82184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0.part /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0.converted {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Successfully created port: 00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0.part /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0.converted" returned: 0 in 0.339s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0.converted --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0.converted --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "05066d1209cdc5effee2113fba12d887d85fd1e0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.925s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0 --force-share --output=json" returned: 0 in 0.128s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "05066d1209cdc5effee2113fba12d887d85fd1e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "05066d1209cdc5effee2113fba12d887d85fd1e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0 --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0,backing_fmt=raw /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0,backing_fmt=raw /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk 1073741824" returned: 0 in 0.051s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "05066d1209cdc5effee2113fba12d887d85fd1e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0 --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Cannot resize image /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'migration_context' on Instance uuid 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Ensure instance console log exists: /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Successfully updated port: 00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquired lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aad7f5c-017a-4282-a273-c5602c3890b3 req-0b18b39a-7c77-4c78-b5a5-397c85c7aa99 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-changed-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG nova.compute.manager [req-8aad7f5c-017a-4282-a273-c5602c3890b3 req-0b18b39a-7c77-4c78-b5a5-397c85c7aa99 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Refreshing instance network info cache due to event network-changed-00eb0800-cff6-4e7f-aa82-0103d8cc5153. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aad7f5c-017a-4282-a273-c5602c3890b3 req-0b18b39a-7c77-4c78-b5a5-397c85c7aa99 service nova] Acquiring lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:20:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating instance_info_cache with network_info: [{"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Releasing lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Instance network_info: |[{"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aad7f5c-017a-4282-a273-c5602c3890b3 req-0b18b39a-7c77-4c78-b5a5-397c85c7aa99 service nova] Acquired lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-8aad7f5c-017a-4282-a273-c5602c3890b3 req-0b18b39a-7c77-4c78-b5a5-397c85c7aa99 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Refreshing network info cache for port 00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Start _get_guest_xml network_info=[{"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T02:20:10Z,direct_url=<?>,disk_format='qcow2',id=b6ae0cea-7c74-495d-ae4c-3c01f51c692e,min_disk=0,min_ram=0,name='tempest-scenario-img--621406878',owner='71b73a0cde174feeb85558cebb13d137',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T02:20:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': 'b6ae0cea-7c74-495d-ae4c-3c01f51c692e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:20:15 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:20:15 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T02:20:10Z,direct_url=<?>,disk_format='qcow2',id=b6ae0cea-7c74-495d-ae4c-3c01f51c692e,min_disk=0,min_ram=0,name='tempest-scenario-img--621406878',owner='71b73a0cde174feeb85558cebb13d137',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T02:20:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-47460833',display_name='tempest-TestMinimumBasicScenario-server-47460833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-47460833',id=41,image_ref='b6ae0cea-7c74-495d-ae4c-3c01f51c692e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRiQvqoiry2HzQuAwe/Vgtc//3bwoA4G8ab1sp4euF4u2N4/2/yd2ZM5F60Io7Szs5Bjs3LQMxAsDKjmtd2F35MDF3acLGrWxj7gQuIphjSqqZuF6DF4p1A0yUIs40Gkg==',key_name='tempest-TestMinimumBasicScenario-930950318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b73a0cde174feeb85558cebb13d137',ramdisk_id='',reservation_id='r-qroe61zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6ae0cea-7c74-495d-ae4c-3c01f51c692e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-934200257',owner_user_name='tempest-TestMinimumBasicScenario-934200257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:20:13Z,user_data=None,user_id='88570fbc28654337a032da5fa1f58814',uuid=5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converting VIF {"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:08:79,bridge_name='br-int',has_traffic_filtering=True,id=00eb0800-cff6-4e7f-aa82-0103d8cc5153,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00eb0800-cf') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:20:15 user nova-compute[82184]:   <uuid>5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f</uuid>
Apr 12 02:20:15 user nova-compute[82184]:   <name>instance-00000029</name>
Apr 12 02:20:15 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:20:15 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:20:15 user nova-compute[82184]:   <metadata>
Apr 12 02:20:15 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:20:15 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:20:15 user nova-compute[82184]:       <nova:name>tempest-TestMinimumBasicScenario-server-47460833</nova:name>
Apr 12 02:20:15 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:20:15</nova:creationTime>
Apr 12 02:20:15 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:20:15 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:20:15 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:20:15 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:20:15 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:20:15 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:20:15 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:20:15 user nova-compute[82184]:       <nova:owner>
Apr 12 02:20:15 user nova-compute[82184]:         <nova:user uuid="88570fbc28654337a032da5fa1f58814">tempest-TestMinimumBasicScenario-934200257-project-member</nova:user>
Apr 12 02:20:15 user nova-compute[82184]:         <nova:project uuid="71b73a0cde174feeb85558cebb13d137">tempest-TestMinimumBasicScenario-934200257</nova:project>
Apr 12 02:20:15 user nova-compute[82184]:       </nova:owner>
Apr 12 02:20:15 user nova-compute[82184]:       <nova:root type="image" uuid="b6ae0cea-7c74-495d-ae4c-3c01f51c692e"/>
Apr 12 02:20:15 user nova-compute[82184]:       <nova:ports>
Apr 12 02:20:15 user nova-compute[82184]:         <nova:port uuid="00eb0800-cff6-4e7f-aa82-0103d8cc5153">
Apr 12 02:20:15 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 02:20:15 user nova-compute[82184]:         </nova:port>
Apr 12 02:20:15 user nova-compute[82184]:       </nova:ports>
Apr 12 02:20:15 user nova-compute[82184]:     </nova:instance>
Apr 12 02:20:15 user nova-compute[82184]:   </metadata>
Apr 12 02:20:15 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:20:15 user nova-compute[82184]:     <system>
Apr 12 02:20:15 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:20:15 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:20:15 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:20:15 user nova-compute[82184]:       <entry name="serial">5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f</entry>
Apr 12 02:20:15 user nova-compute[82184]:       <entry name="uuid">5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f</entry>
Apr 12 02:20:15 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:20:15 user nova-compute[82184]:     </system>
Apr 12 02:20:15 user nova-compute[82184]:   </sysinfo>
Apr 12 02:20:15 user nova-compute[82184]:   <os>
Apr 12 02:20:15 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:20:15 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:20:15 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:20:15 user nova-compute[82184]:   </os>
Apr 12 02:20:15 user nova-compute[82184]:   <features>
Apr 12 02:20:15 user nova-compute[82184]:     <acpi/>
Apr 12 02:20:15 user nova-compute[82184]:     <apic/>
Apr 12 02:20:15 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:20:15 user nova-compute[82184]:   </features>
Apr 12 02:20:15 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:20:15 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:20:15 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:20:15 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:20:15 user nova-compute[82184]:   </clock>
Apr 12 02:20:15 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:20:15 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:20:15 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:20:15 user nova-compute[82184]:   </cpu>
Apr 12 02:20:15 user nova-compute[82184]:   <devices>
Apr 12 02:20:15 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:20:15 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:20:15 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk"/>
Apr 12 02:20:15 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:20:15 user nova-compute[82184]:     </disk>
Apr 12 02:20:15 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:20:15 user nova-compute[82184]:       <mac address="fa:16:3e:79:08:79"/>
Apr 12 02:20:15 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:20:15 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:20:15 user nova-compute[82184]:       <target dev="tap00eb0800-cf"/>
Apr 12 02:20:15 user nova-compute[82184]:     </interface>
Apr 12 02:20:15 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:20:15 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/console.log" append="off"/>
Apr 12 02:20:15 user nova-compute[82184]:     </serial>
Apr 12 02:20:15 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:20:15 user nova-compute[82184]:     <video>
Apr 12 02:20:15 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:20:15 user nova-compute[82184]:     </video>
Apr 12 02:20:15 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:20:15 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:20:15 user nova-compute[82184]:     </rng>
Apr 12 02:20:15 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:20:15 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:20:15 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:20:15 user nova-compute[82184]:     </memballoon>
Apr 12 02:20:15 user nova-compute[82184]:   </devices>
Apr 12 02:20:15 user nova-compute[82184]: </domain>
Apr 12 02:20:15 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-47460833',display_name='tempest-TestMinimumBasicScenario-server-47460833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-47460833',id=41,image_ref='b6ae0cea-7c74-495d-ae4c-3c01f51c692e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRiQvqoiry2HzQuAwe/Vgtc//3bwoA4G8ab1sp4euF4u2N4/2/yd2ZM5F60Io7Szs5Bjs3LQMxAsDKjmtd2F35MDF3acLGrWxj7gQuIphjSqqZuF6DF4p1A0yUIs40Gkg==',key_name='tempest-TestMinimumBasicScenario-930950318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b73a0cde174feeb85558cebb13d137',ramdisk_id='',reservation_id='r-qroe61zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6ae0cea-7c74-495d-ae4c-3c01f51c692e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-934200257',owner_user_name='tempest-TestMinimumBasicScenario-934200257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:20:13Z,user_data=None,user_id='88570fbc28654337a032da5fa1f58814',uuid=5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converting VIF {"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:08:79,bridge_name='br-int',has_traffic_filtering=True,id=00eb0800-cff6-4e7f-aa82-0103d8cc5153,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00eb0800-cf') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG os_vif [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:08:79,bridge_name='br-int',has_traffic_filtering=True,id=00eb0800-cff6-4e7f-aa82-0103d8cc5153,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00eb0800-cf') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00eb0800-cf, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap00eb0800-cf, col_values=(('external_ids', {'iface-id': '00eb0800-cff6-4e7f-aa82-0103d8cc5153', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:08:79', 'vm-uuid': '5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:15 user nova-compute[82184]: INFO os_vif [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:08:79,bridge_name='br-int',has_traffic_filtering=True,id=00eb0800-cff6-4e7f-aa82-0103d8cc5153,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00eb0800-cf')
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] No VIF found with MAC fa:16:3e:79:08:79, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-8aad7f5c-017a-4282-a273-c5602c3890b3 req-0b18b39a-7c77-4c78-b5a5-397c85c7aa99 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updated VIF entry in instance network info cache for port 00eb0800-cff6-4e7f-aa82-0103d8cc5153. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-8aad7f5c-017a-4282-a273-c5602c3890b3 req-0b18b39a-7c77-4c78-b5a5-397c85c7aa99 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating instance_info_cache with network_info: [{"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:20:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8aad7f5c-017a-4282-a273-c5602c3890b3 req-0b18b39a-7c77-4c78-b5a5-397c85c7aa99 service nova] Releasing lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:20:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-b0f3a69f-e70f-4b3e-b7cc-0dab258ef9a4 req-66a4d938-dc15-472c-a861-948cb75c6e37 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:20:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b0f3a69f-e70f-4b3e-b7cc-0dab258ef9a4 req-66a4d938-dc15-472c-a861-948cb75c6e37 service nova] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b0f3a69f-e70f-4b3e-b7cc-0dab258ef9a4 req-66a4d938-dc15-472c-a861-948cb75c6e37 service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b0f3a69f-e70f-4b3e-b7cc-0dab258ef9a4 req-66a4d938-dc15-472c-a861-948cb75c6e37 service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-b0f3a69f-e70f-4b3e-b7cc-0dab258ef9a4 req-66a4d938-dc15-472c-a861-948cb75c6e37 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] No waiting events found dispatching network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:20:16 user nova-compute[82184]: WARNING nova.compute.manager [req-b0f3a69f-e70f-4b3e-b7cc-0dab258ef9a4 req-66a4d938-dc15-472c-a861-948cb75c6e37 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received unexpected event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 for instance with vm_state building and task_state spawning.
Apr 12 02:20:16 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:20:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:20:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266018.5371745, 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:20:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] VM Resumed (Lifecycle Event)
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:20:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Instance spawned successfully.
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:20:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266018.5387995, 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:20:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] VM Started (Lifecycle Event)
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:20:18 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:20:18 user nova-compute[82184]: INFO nova.compute.manager [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Took 5.51 seconds to spawn the instance on the hypervisor.
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:20:18 user nova-compute[82184]: INFO nova.compute.manager [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Took 6.09 seconds to build instance.
Apr 12 02:20:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6d87491b-1d57-4a74-be39-7a5bfefc26aa tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.183s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-ff148665-aa8d-4ad3-a0cd-2cd26ddbbc2d req-54e60d71-5986-4e30-98fa-2978746131c2 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ff148665-aa8d-4ad3-a0cd-2cd26ddbbc2d req-54e60d71-5986-4e30-98fa-2978746131c2 service nova] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ff148665-aa8d-4ad3-a0cd-2cd26ddbbc2d req-54e60d71-5986-4e30-98fa-2978746131c2 service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ff148665-aa8d-4ad3-a0cd-2cd26ddbbc2d req-54e60d71-5986-4e30-98fa-2978746131c2 service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:18 user nova-compute[82184]: DEBUG nova.compute.manager [req-ff148665-aa8d-4ad3-a0cd-2cd26ddbbc2d req-54e60d71-5986-4e30-98fa-2978746131c2 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] No waiting events found dispatching network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:20:18 user nova-compute[82184]: WARNING nova.compute.manager [req-ff148665-aa8d-4ad3-a0cd-2cd26ddbbc2d req-54e60d71-5986-4e30-98fa-2978746131c2 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received unexpected event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 for instance with vm_state active and task_state None.
Apr 12 02:20:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-b5b0a51b-a9d8-4a60-b7f6-ea0091f316ac req-b87dbd3e-fcd3-4f6e-a9e0-6bb6b745a029 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received event network-changed-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-b5b0a51b-a9d8-4a60-b7f6-ea0091f316ac req-b87dbd3e-fcd3-4f6e-a9e0-6bb6b745a029 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Refreshing instance network info cache due to event network-changed-f3bfac63-9965-4cc9-9c67-91d735cdcc43. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b5b0a51b-a9d8-4a60-b7f6-ea0091f316ac req-b87dbd3e-fcd3-4f6e-a9e0-6bb6b745a029 service nova] Acquiring lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b5b0a51b-a9d8-4a60-b7f6-ea0091f316ac req-b87dbd3e-fcd3-4f6e-a9e0-6bb6b745a029 service nova] Acquired lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG nova.network.neutron [req-b5b0a51b-a9d8-4a60-b7f6-ea0091f316ac req-b87dbd3e-fcd3-4f6e-a9e0-6bb6b745a029 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Refreshing network info cache for port f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "8553081b-42a3-45c9-a6f6-248315547366" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "8553081b-42a3-45c9-a6f6-248315547366" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "8553081b-42a3-45c9-a6f6-248315547366-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "8553081b-42a3-45c9-a6f6-248315547366-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "8553081b-42a3-45c9-a6f6-248315547366-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:34 user nova-compute[82184]: INFO nova.compute.manager [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Terminating instance
Apr 12 02:20:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG nova.network.neutron [req-b5b0a51b-a9d8-4a60-b7f6-ea0091f316ac req-b87dbd3e-fcd3-4f6e-a9e0-6bb6b745a029 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updated VIF entry in instance network info cache for port f3bfac63-9965-4cc9-9c67-91d735cdcc43. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG nova.network.neutron [req-b5b0a51b-a9d8-4a60-b7f6-ea0091f316ac req-b87dbd3e-fcd3-4f6e-a9e0-6bb6b745a029 service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updating instance_info_cache with network_info: [{"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b5b0a51b-a9d8-4a60-b7f6-ea0091f316ac req-b87dbd3e-fcd3-4f6e-a9e0-6bb6b745a029 service nova] Releasing lock "refresh_cache-8553081b-42a3-45c9-a6f6-248315547366" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Instance destroyed successfully.
Apr 12 02:20:35 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lazy-loading 'resources' on Instance uuid 8553081b-42a3-45c9-a6f6-248315547366 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1500776453',display_name='tempest-TestVolumeBootPattern-server-1500776453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1500776453',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZLzl+dJPPiQ1Q3KddtYvgtfp4Cw3N4yjPTn4jGAIGgcnNkNcoYvsYhuJ1X9VE6SsNAdPUgVuioRnH9/wkBTudNIYOOGxrInu47Q267Lh/dzVGncnNeYWswwovQJnMLew==',key_name='tempest-TestVolumeBootPattern-1281564430',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:16:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcd685278576490480a97cd2bc5e048b',ramdisk_id='',reservation_id='r-o9elig80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2043953815',owner_user_name='tempest-TestVolumeBootPattern-2043953815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:16:03Z,user_data=None,user_id='69d5d81fffb14b1cab84b6160ceb7dd2',uuid=8553081b-42a3-45c9-a6f6-248315547366,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converting VIF {"id": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "address": "fa:16:3e:6d:0c:79", "network": {"id": "d395449e-6635-4d1d-afe6-aa4a3c403969", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059171480-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bcd685278576490480a97cd2bc5e048b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3bfac63-99", "ovs_interfaceid": "f3bfac63-9965-4cc9-9c67-91d735cdcc43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:0c:79,bridge_name='br-int',has_traffic_filtering=True,id=f3bfac63-9965-4cc9-9c67-91d735cdcc43,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bfac63-99') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_vif [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:0c:79,bridge_name='br-int',has_traffic_filtering=True,id=f3bfac63-9965-4cc9-9c67-91d735cdcc43,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bfac63-99') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3bfac63-99, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:20:35 user nova-compute[82184]: INFO os_vif [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:0c:79,bridge_name='br-int',has_traffic_filtering=True,id=f3bfac63-9965-4cc9-9c67-91d735cdcc43,network=Network(d395449e-6635-4d1d-afe6-aa4a3c403969),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3bfac63-99')
Apr 12 02:20:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUiuEkPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:20:35 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4163ba29-0126-4aa8-90b8-8c9f78f51da5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:20:35 user nova-compute[82184]: No targets found.
Apr 12 02:20:35 user nova-compute[82184]: iSNS:
Apr 12 02:20:35 user nova-compute[82184]: No targets found.
Apr 12 02:20:35 user nova-compute[82184]: STATIC:
Apr 12 02:20:35 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34
Apr 12 02:20:35 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:20:35 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:20:35 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5
Apr 12 02:20:35 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:20:35 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:20:35 user nova-compute[82184]: FIRMWARE:
Apr 12 02:20:35 user nova-compute[82184]: No targets found.
Apr 12 02:20:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:20:35 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:20:35 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6254ebf-85c6-4f46-ad81-66f402823dd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d24615-407e-4fbb-a243-65a18bd85261]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:20:35 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:20:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 (non-flash)
Apr 12 02:20:35 user nova-compute[82184]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:20:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a8149d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb50a21-23d4-46ec-8be0-ccd8036ac799]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9340cde-d981-43b2-888b-d1f4c6688cbb]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1803e5fe-73ff-4446-94d3-06d24c7fd39f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0403ca-1331-4fd3-869a-144013b7b720]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8dfddebe', '/dev/disk/by-id/scsi-1SCST_BIO8dfddebe-f0642ceeb574dd09', '/dev/disk/by-id/scsi-26630363432636565') {{(pid=92498) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[432855be-e5dd-448c-9bf2-c9d06bf73cf2]: (4, None) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ff944c-e276-4668-9c0f-6b8cdd74eec8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[51693fd8-8286-4808-add1-3c3f3bad1ac5]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260]
Apr 12 02:20:35 user nova-compute[82184]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5, portal: 172.16.0.220,3260] successful.
Apr 12 02:20:35 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0dc4ffd-98fa-4a8c-8843-73706a802dc5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bbd75e-afdb-4c4d-91e5-59a39b2ec076]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] <== disconnect_volume: return (315ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:20:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Deleting instance files /opt/stack/data/nova/instances/8553081b-42a3-45c9-a6f6-248315547366_del
Apr 12 02:20:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Deletion of /opt/stack/data/nova/instances/8553081b-42a3-45c9-a6f6-248315547366_del complete
Apr 12 02:20:35 user nova-compute[82184]: INFO nova.compute.manager [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 12 02:20:35 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:20:35 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 8553081b-42a3-45c9-a6f6-248315547366] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:20:36 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Took 0.46 seconds to deallocate network for instance.
Apr 12 02:20:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received event network-vif-unplugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] Acquiring lock "8553081b-42a3-45c9-a6f6-248315547366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] Lock "8553081b-42a3-45c9-a6f6-248315547366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] Lock "8553081b-42a3-45c9-a6f6-248315547366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] No waiting events found dispatching network-vif-unplugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received event network-vif-unplugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received event network-vif-plugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] Acquiring lock "8553081b-42a3-45c9-a6f6-248315547366-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] Lock "8553081b-42a3-45c9-a6f6-248315547366-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] Lock "8553081b-42a3-45c9-a6f6-248315547366-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] No waiting events found dispatching network-vif-plugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:20:36 user nova-compute[82184]: WARNING nova.compute.manager [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received unexpected event network-vif-plugged-f3bfac63-9965-4cc9-9c67-91d735cdcc43 for instance with vm_state active and task_state deleting.
Apr 12 02:20:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-31c01f9b-57ee-4662-be65-47b75758477d req-24986bdb-65c2-4ef8-9d75-35b78f526d0d service nova] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Received event network-vif-deleted-f3bfac63-9965-4cc9-9c67-91d735cdcc43 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:20:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:36 user nova-compute[82184]: INFO nova.compute.manager [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Took 0.74 seconds to detach 1 volumes for instance.
Apr 12 02:20:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:20:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:20:37 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:20:37 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:20:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:37 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Deleted allocations for instance 8553081b-42a3-45c9-a6f6-248315547366
Apr 12 02:20:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4fbe1f0e-3350-43d2-8fa3-954a5b105c47 tempest-TestVolumeBootPattern-2043953815 tempest-TestVolumeBootPattern-2043953815-project-member] Lock "8553081b-42a3-45c9-a6f6-248315547366" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.737s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:20:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:50 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681266035.3584318, 8553081b-42a3-45c9-a6f6-248315547366 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:20:50 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 8553081b-42a3-45c9-a6f6-248315547366] VM Stopped (Lifecycle Event)
Apr 12 02:20:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-15893a16-f699-408f-8eb3-67ef88bbab74 None None] [instance: 8553081b-42a3-45c9-a6f6-248315547366] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:20:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:20:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:21:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:21:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:21:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:21:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:21:05 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:21:05 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:21:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:21:06 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:07 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:21:07 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:21:07 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8522MB free_disk=26.248634338378906GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:21:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:21:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:21:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:21:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:21:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:21:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updating instance_info_cache with network_info: [{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:21:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:21:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:21:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:21:17 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:21:18 user nova-compute[82184]: INFO nova.compute.manager [None req-3c2cefa8-cc3e-47a7-a9f9-c1d324cf14d3 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Unrescuing
Apr 12 02:21:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3c2cefa8-cc3e-47a7-a9f9-c1d324cf14d3 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:21:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3c2cefa8-cc3e-47a7-a9f9-c1d324cf14d3 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquired lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:21:18 user nova-compute[82184]: DEBUG nova.network.neutron [None req-3c2cefa8-cc3e-47a7-a9f9-c1d324cf14d3 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG nova.network.neutron [None req-3c2cefa8-cc3e-47a7-a9f9-c1d324cf14d3 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updating instance_info_cache with network_info: [{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3c2cefa8-cc3e-47a7-a9f9-c1d324cf14d3 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Releasing lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG nova.objects.instance [None req-3c2cefa8-cc3e-47a7-a9f9-c1d324cf14d3 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'flavor' on Instance uuid 811c4fb7-d984-461e-9190-4d0e9ec345c2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-8cf2cf74-db28-461d-a766-8f46d0edf277 req-96a2d554-5f70-4fd7-a998-b272978552ce service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-unplugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8cf2cf74-db28-461d-a766-8f46d0edf277 req-96a2d554-5f70-4fd7-a998-b272978552ce service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8cf2cf74-db28-461d-a766-8f46d0edf277 req-96a2d554-5f70-4fd7-a998-b272978552ce service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8cf2cf74-db28-461d-a766-8f46d0edf277 req-96a2d554-5f70-4fd7-a998-b272978552ce service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:21:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-8cf2cf74-db28-461d-a766-8f46d0edf277 req-96a2d554-5f70-4fd7-a998-b272978552ce service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-unplugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:21:19 user nova-compute[82184]: WARNING nova.compute.manager [req-8cf2cf74-db28-461d-a766-8f46d0edf277 req-96a2d554-5f70-4fd7-a998-b272978552ce service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-unplugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state rescued and task_state unrescuing.
Apr 12 02:21:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:20 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Instance destroyed successfully.
Apr 12 02:21:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:21:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:21:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:21:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:21:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:21:22 user nova-compute[82184]: WARNING nova.compute.manager [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state rescued and task_state unrescuing.
Apr 12 02:21:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:21:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:21:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:21:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:21:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:21:22 user nova-compute[82184]: WARNING nova.compute.manager [req-1625a710-9bc8-45b0-b1b5-01fd635873cd req-c9b754d3-676e-45f8-aabe-b9cdbeecc9e2 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state rescued and task_state unrescuing.
Apr 12 02:21:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for 811c4fb7-d984-461e-9190-4d0e9ec345c2 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 02:21:23 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266083.937942, 811c4fb7-d984-461e-9190-4d0e9ec345c2 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:21:23 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] VM Resumed (Lifecycle Event)
Apr 12 02:21:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-3c2cefa8-cc3e-47a7-a9f9-c1d324cf14d3 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:21:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:21:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:21:23 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 02:21:23 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266083.9423928, 811c4fb7-d984-461e-9190-4d0e9ec345c2 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:21:23 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] VM Started (Lifecycle Event)
Apr 12 02:21:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:21:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:21:24 user nova-compute[82184]: DEBUG nova.compute.manager [req-d8146e8c-8bf9-434f-a976-6485fc6ff458 req-4d29478d-73b1-427d-bab8-e975b304d54c service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:21:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d8146e8c-8bf9-434f-a976-6485fc6ff458 req-4d29478d-73b1-427d-bab8-e975b304d54c service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:21:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d8146e8c-8bf9-434f-a976-6485fc6ff458 req-4d29478d-73b1-427d-bab8-e975b304d54c service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:21:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d8146e8c-8bf9-434f-a976-6485fc6ff458 req-4d29478d-73b1-427d-bab8-e975b304d54c service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:21:24 user nova-compute[82184]: DEBUG nova.compute.manager [req-d8146e8c-8bf9-434f-a976-6485fc6ff458 req-4d29478d-73b1-427d-bab8-e975b304d54c service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:21:24 user nova-compute[82184]: WARNING nova.compute.manager [req-d8146e8c-8bf9-434f-a976-6485fc6ff458 req-4d29478d-73b1-427d-bab8-e975b304d54c service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state active and task_state None.
Apr 12 02:21:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:21:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:21:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:21:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:21:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:21:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:22:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:22:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:22:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:22:04 user nova-compute[82184]: DEBUG nova.objects.instance [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'flavor' on Instance uuid 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:22:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:22:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:22:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:22:04 user nova-compute[82184]: INFO nova.compute.manager [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Attaching volume 6f29ab89-68a0-4841-9a41-173da8724057 to /dev/vdb
Apr 12 02:22:05 user nova-compute[82184]: DEBUG os_brick.utils [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0351553b-2756-48d6-a136-eff2ef5ceb41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58c8456-0573-42c6-9862-b17d824d5db3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f241581b-9a5d-4cb2-94a0-48c7593acde3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fd1e91-d19a-476d-a529-1d7623c06f28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:22:05 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:22:05 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[37807e2d-5229-4a0f-ab16-ca193d9f8cc8]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG os_brick.utils [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating existing volume attachment record: 3a198de5-4969-4ce2-a4d2-cde98da9841d {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:22:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:22:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:22:07 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:22:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:22:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:22:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:22:07 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:22:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:22:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:08 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:22:08 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:22:08 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=26.246196746826172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:22:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:22:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exYFCQAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:22:09 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:22:09 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:22:09 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb12a33f-144a-4874-a028-170ce56a814f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:22:09 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b60479-0df3-4b55-999a-2b975ac65ecf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057] added
Apr 12 02:22:09 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c397ffb-164c-4273-8186-98dc66e2bfcb]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c72a5ac-b51c-40a0-b404-92c82f46fc31]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exYFCQAz {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exYFCQAz" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ddd6ea-a34a-47c2-b244-0602059430ae]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'exYFCQAz'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa72c7b5-b7da-4a06-a6c4-fb846b21822c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6f97fb-2d7a-4dcb-a1ad-d3473e4efb2a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:22:09 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:22:09 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee42cb2c-784e-49de-90fa-b04678676fae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057, portal: 172.16.0.220,3260]
Apr 12 02:22:09 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057, portal: 172.16.0.220,3260] successful.
Apr 12 02:22:09 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5338f6-9d9e-41d4-bae7-e9eb35eae6ef]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[118a8fa2-c85a-4bf5-9053-30c6e7063fcf]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:22:09 user nova-compute[82184]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 (non-flash)
Apr 12 02:22:09 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:22:09 user nova-compute[82184]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 (non-flash)
Apr 12 02:22:09 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef680d9-bbcb-486b-b055-0e871a5d8d60]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:22:09 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exYFCQAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:22:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:22:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23762643237333631', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:22:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762643237333631', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:22:10 user nova-compute[82184]: DEBUG nova.objects.instance [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'flavor' on Instance uuid 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:22:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:22:10 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:22:10 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:22:10 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:22:10 user nova-compute[82184]:   <serial>6f29ab89-68a0-4841-9a41-173da8724057</serial>
Apr 12 02:22:10 user nova-compute[82184]: </disk>
Apr 12 02:22:10 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:22:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:22:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:22:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] No VIF found with MAC fa:16:3e:79:08:79, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:22:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bf4a7626-f491-41fd-b89a-d0b94f373368 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.595s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:22:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:22:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:22:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:22:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:22:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:22:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:22:12 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 3036c0b5-7987-4ff5-9edf-ee7397cf7beb {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:22:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updating instance_info_cache with network_info: [{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:22:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:22:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:22:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:22:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:22:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:22:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:22:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-7180d396-1570-42c2-bf27-e8d057289878 req-b00b8429-5a48-4366-b641-4bab9af804f4 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-changed-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:22:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-7180d396-1570-42c2-bf27-e8d057289878 req-b00b8429-5a48-4366-b641-4bab9af804f4 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Refreshing instance network info cache due to event network-changed-00eb0800-cff6-4e7f-aa82-0103d8cc5153. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:22:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7180d396-1570-42c2-bf27-e8d057289878 req-b00b8429-5a48-4366-b641-4bab9af804f4 service nova] Acquiring lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:22:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7180d396-1570-42c2-bf27-e8d057289878 req-b00b8429-5a48-4366-b641-4bab9af804f4 service nova] Acquired lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:22:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-7180d396-1570-42c2-bf27-e8d057289878 req-b00b8429-5a48-4366-b641-4bab9af804f4 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Refreshing network info cache for port 00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:22:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-7180d396-1570-42c2-bf27-e8d057289878 req-b00b8429-5a48-4366-b641-4bab9af804f4 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updated VIF entry in instance network info cache for port 00eb0800-cff6-4e7f-aa82-0103d8cc5153. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:22:15 user nova-compute[82184]: DEBUG nova.network.neutron [req-7180d396-1570-42c2-bf27-e8d057289878 req-b00b8429-5a48-4366-b641-4bab9af804f4 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating instance_info_cache with network_info: [{"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:22:15 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:22:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7180d396-1570-42c2-bf27-e8d057289878 req-b00b8429-5a48-4366-b641-4bab9af804f4 service nova] Releasing lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:22:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-0790371b-2ac5-4748-b4bb-0f4f82d19d03 req-bb98a1df-8a19-4b47-a66a-3118cbeb37ec service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-changed-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:22:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-0790371b-2ac5-4748-b4bb-0f4f82d19d03 req-bb98a1df-8a19-4b47-a66a-3118cbeb37ec service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Refreshing instance network info cache due to event network-changed-00eb0800-cff6-4e7f-aa82-0103d8cc5153. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:22:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0790371b-2ac5-4748-b4bb-0f4f82d19d03 req-bb98a1df-8a19-4b47-a66a-3118cbeb37ec service nova] Acquiring lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:22:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0790371b-2ac5-4748-b4bb-0f4f82d19d03 req-bb98a1df-8a19-4b47-a66a-3118cbeb37ec service nova] Acquired lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:22:17 user nova-compute[82184]: DEBUG nova.network.neutron [req-0790371b-2ac5-4748-b4bb-0f4f82d19d03 req-bb98a1df-8a19-4b47-a66a-3118cbeb37ec service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Refreshing network info cache for port 00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:22:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:22:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:22:17 user nova-compute[82184]: INFO nova.compute.manager [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Rebooting instance
Apr 12 02:22:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:22:18 user nova-compute[82184]: DEBUG nova.network.neutron [req-0790371b-2ac5-4748-b4bb-0f4f82d19d03 req-bb98a1df-8a19-4b47-a66a-3118cbeb37ec service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updated VIF entry in instance network info cache for port 00eb0800-cff6-4e7f-aa82-0103d8cc5153. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:22:18 user nova-compute[82184]: DEBUG nova.network.neutron [req-0790371b-2ac5-4748-b4bb-0f4f82d19d03 req-bb98a1df-8a19-4b47-a66a-3118cbeb37ec service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating instance_info_cache with network_info: [{"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:22:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0790371b-2ac5-4748-b4bb-0f4f82d19d03 req-bb98a1df-8a19-4b47-a66a-3118cbeb37ec service nova] Releasing lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:22:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquired lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:22:18 user nova-compute[82184]: DEBUG nova.network.neutron [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:22:18 user nova-compute[82184]: DEBUG nova.network.neutron [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating instance_info_cache with network_info: [{"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:22:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Releasing lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:22:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:22:19 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:22:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:22:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-f5ed7446-409f-421f-aebf-d0574ef852f5 req-d2068c33-70a6-4dba-8334-3bfbf2a9bd69 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-vif-unplugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:22:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f5ed7446-409f-421f-aebf-d0574ef852f5 req-d2068c33-70a6-4dba-8334-3bfbf2a9bd69 service nova] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:22:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f5ed7446-409f-421f-aebf-d0574ef852f5 req-d2068c33-70a6-4dba-8334-3bfbf2a9bd69 service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:22:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f5ed7446-409f-421f-aebf-d0574ef852f5 req-d2068c33-70a6-4dba-8334-3bfbf2a9bd69 service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:22:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-f5ed7446-409f-421f-aebf-d0574ef852f5 req-d2068c33-70a6-4dba-8334-3bfbf2a9bd69 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] No waiting events found dispatching network-vif-unplugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:22:21 user nova-compute[82184]: WARNING nova.compute.manager [req-f5ed7446-409f-421f-aebf-d0574ef852f5 req-d2068c33-70a6-4dba-8334-3bfbf2a9bd69 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received unexpected event network-vif-unplugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 for instance with vm_state active and task_state reboot_started.
Apr 12 02:22:21 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Instance shutdown successfully.
Apr 12 02:22:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] No waiting events found dispatching network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:22:23 user nova-compute[82184]: WARNING nova.compute.manager [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received unexpected event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 for instance with vm_state active and task_state reboot_started.
Apr 12 02:22:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] No waiting events found dispatching network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:22:23 user nova-compute[82184]: WARNING nova.compute.manager [req-937873de-1402-4eae-bbfc-4e5d01b957ae req-aff18b18-de16-44d8-8e37-259f8abf793a service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received unexpected event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 for instance with vm_state active and task_state reboot_started.
Apr 12 02:22:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-0b3ac299-5f05-4329-8fc8-b636b70a3024 req-8d5ff41f-281f-4331-a678-4ff8b4804dec service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0b3ac299-5f05-4329-8fc8-b636b70a3024 req-8d5ff41f-281f-4331-a678-4ff8b4804dec service nova] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0b3ac299-5f05-4329-8fc8-b636b70a3024 req-8d5ff41f-281f-4331-a678-4ff8b4804dec service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0b3ac299-5f05-4329-8fc8-b636b70a3024 req-8d5ff41f-281f-4331-a678-4ff8b4804dec service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-0b3ac299-5f05-4329-8fc8-b636b70a3024 req-8d5ff41f-281f-4331-a678-4ff8b4804dec service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] No waiting events found dispatching network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:22:25 user nova-compute[82184]: WARNING nova.compute.manager [req-0b3ac299-5f05-4329-8fc8-b636b70a3024 req-8d5ff41f-281f-4331-a678-4ff8b4804dec service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received unexpected event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 for instance with vm_state active and task_state reboot_started.
Apr 12 02:22:25 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266145.2491617, 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:22:25 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] VM Resumed (Lifecycle Event)
Apr 12 02:22:25 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Instance running successfully.
Apr 12 02:22:25 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Instance soft rebooted successfully.
Apr 12 02:22:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:22:25 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 12 02:22:25 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266145.250482, 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:22:25 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] VM Started (Lifecycle Event)
Apr 12 02:22:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9892ab58-98d1-415d-b9ce-66da4aaff14f tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.417s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:22:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:22:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:23:04 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:23:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:23:07 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:23:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:23:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:23:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:23:07 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:23:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:23:07 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:23:08 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:23:08 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:23:08 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=26.236190795898438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:23:08 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:23:09 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:23:09 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:23:09 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:23:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:23:10 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:23:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:23:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "35de4fd0-e7b2-484c-b261-fca54a8103a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:23:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:23:11 user nova-compute[82184]: INFO nova.compute.claims [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Claim successful on node user
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:23:11 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.policy [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe9217f4c1ff428086140b7fd07194eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb951049b464316a04647ce9c52963a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:23:11 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Creating image(s)
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "/opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "/opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "/opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:23:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Successfully created port: 30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.458s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk 1073741824" returned: 0 in 0.055s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.517s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Cannot resize image /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'migration_context' on Instance uuid 35de4fd0-e7b2-484c-b261-fca54a8103a8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Ensure instance console log exists: /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updating instance_info_cache with network_info: [{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Successfully updated port: 30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquired lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-1c108a54-fdcc-47e5-b740-0252875d170f req-ef14be87-64a9-41f5-bb11-3cc6e0d95d26 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Received event network-changed-30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.compute.manager [req-1c108a54-fdcc-47e5-b740-0252875d170f req-ef14be87-64a9-41f5-bb11-3cc6e0d95d26 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Refreshing instance network info cache due to event network-changed-30f13766-7037-4c15-82c7-4c1a2eb1f889. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1c108a54-fdcc-47e5-b740-0252875d170f req-ef14be87-64a9-41f5-bb11-3cc6e0d95d26 service nova] Acquiring lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:23:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Updating instance_info_cache with network_info: [{"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Releasing lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Instance network_info: |[{"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1c108a54-fdcc-47e5-b740-0252875d170f req-ef14be87-64a9-41f5-bb11-3cc6e0d95d26 service nova] Acquired lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.network.neutron [req-1c108a54-fdcc-47e5-b740-0252875d170f req-ef14be87-64a9-41f5-bb11-3cc6e0d95d26 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Refreshing network info cache for port 30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Start _get_guest_xml network_info=[{"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:23:13 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:23:13 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1841847417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1841847417',id=42,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-s7tbbdlo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:23:12Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=35de4fd0-e7b2-484c-b261-fca54a8103a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b0:16,bridge_name='br-int',has_traffic_filtering=True,id=30f13766-7037-4c15-82c7-4c1a2eb1f889,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30f13766-70') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'pci_devices' on Instance uuid 35de4fd0-e7b2-484c-b261-fca54a8103a8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:23:13 user nova-compute[82184]:   <uuid>35de4fd0-e7b2-484c-b261-fca54a8103a8</uuid>
Apr 12 02:23:13 user nova-compute[82184]:   <name>instance-0000002a</name>
Apr 12 02:23:13 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:23:13 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:23:13 user nova-compute[82184]:   <metadata>
Apr 12 02:23:13 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:23:13 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:23:13 user nova-compute[82184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1841847417</nova:name>
Apr 12 02:23:13 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:23:13</nova:creationTime>
Apr 12 02:23:13 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:23:13 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:23:13 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:23:13 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:23:13 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:23:13 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:23:13 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:23:13 user nova-compute[82184]:       <nova:owner>
Apr 12 02:23:13 user nova-compute[82184]:         <nova:user uuid="fe9217f4c1ff428086140b7fd07194eb">tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member</nova:user>
Apr 12 02:23:13 user nova-compute[82184]:         <nova:project uuid="6bb951049b464316a04647ce9c52963a">tempest-ServerBootFromVolumeStableRescueTest-1070279577</nova:project>
Apr 12 02:23:13 user nova-compute[82184]:       </nova:owner>
Apr 12 02:23:13 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:23:13 user nova-compute[82184]:       <nova:ports>
Apr 12 02:23:13 user nova-compute[82184]:         <nova:port uuid="30f13766-7037-4c15-82c7-4c1a2eb1f889">
Apr 12 02:23:13 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 02:23:13 user nova-compute[82184]:         </nova:port>
Apr 12 02:23:13 user nova-compute[82184]:       </nova:ports>
Apr 12 02:23:13 user nova-compute[82184]:     </nova:instance>
Apr 12 02:23:13 user nova-compute[82184]:   </metadata>
Apr 12 02:23:13 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:23:13 user nova-compute[82184]:     <system>
Apr 12 02:23:13 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:23:13 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:23:13 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:23:13 user nova-compute[82184]:       <entry name="serial">35de4fd0-e7b2-484c-b261-fca54a8103a8</entry>
Apr 12 02:23:13 user nova-compute[82184]:       <entry name="uuid">35de4fd0-e7b2-484c-b261-fca54a8103a8</entry>
Apr 12 02:23:13 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:23:13 user nova-compute[82184]:     </system>
Apr 12 02:23:13 user nova-compute[82184]:   </sysinfo>
Apr 12 02:23:13 user nova-compute[82184]:   <os>
Apr 12 02:23:13 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:23:13 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:23:13 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:23:13 user nova-compute[82184]:   </os>
Apr 12 02:23:13 user nova-compute[82184]:   <features>
Apr 12 02:23:13 user nova-compute[82184]:     <acpi/>
Apr 12 02:23:13 user nova-compute[82184]:     <apic/>
Apr 12 02:23:13 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:23:13 user nova-compute[82184]:   </features>
Apr 12 02:23:13 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:23:13 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:23:13 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:23:13 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:23:13 user nova-compute[82184]:   </clock>
Apr 12 02:23:13 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:23:13 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:23:13 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:23:13 user nova-compute[82184]:   </cpu>
Apr 12 02:23:13 user nova-compute[82184]:   <devices>
Apr 12 02:23:13 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:23:13 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:23:13 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk"/>
Apr 12 02:23:13 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:23:13 user nova-compute[82184]:     </disk>
Apr 12 02:23:13 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:23:13 user nova-compute[82184]:       <mac address="fa:16:3e:d6:b0:16"/>
Apr 12 02:23:13 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:23:13 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:23:13 user nova-compute[82184]:       <target dev="tap30f13766-70"/>
Apr 12 02:23:13 user nova-compute[82184]:     </interface>
Apr 12 02:23:13 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:23:13 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/console.log" append="off"/>
Apr 12 02:23:13 user nova-compute[82184]:     </serial>
Apr 12 02:23:13 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:23:13 user nova-compute[82184]:     <video>
Apr 12 02:23:13 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:23:13 user nova-compute[82184]:     </video>
Apr 12 02:23:13 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:23:13 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:23:13 user nova-compute[82184]:     </rng>
Apr 12 02:23:13 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:23:13 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:23:13 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:23:13 user nova-compute[82184]:     </memballoon>
Apr 12 02:23:13 user nova-compute[82184]:   </devices>
Apr 12 02:23:13 user nova-compute[82184]: </domain>
Apr 12 02:23:13 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1841847417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1841847417',id=42,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-s7tbbdlo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:23:12Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=35de4fd0-e7b2-484c-b261-fca54a8103a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b0:16,bridge_name='br-int',has_traffic_filtering=True,id=30f13766-7037-4c15-82c7-4c1a2eb1f889,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30f13766-70') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG os_vif [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b0:16,bridge_name='br-int',has_traffic_filtering=True,id=30f13766-7037-4c15-82c7-4c1a2eb1f889,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30f13766-70') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30f13766-70, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30f13766-70, col_values=(('external_ids', {'iface-id': '30f13766-7037-4c15-82c7-4c1a2eb1f889', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:b0:16', 'vm-uuid': '35de4fd0-e7b2-484c-b261-fca54a8103a8'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:13 user nova-compute[82184]: INFO os_vif [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:b0:16,bridge_name='br-int',has_traffic_filtering=True,id=30f13766-7037-4c15-82c7-4c1a2eb1f889,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30f13766-70')
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No VIF found with MAC fa:16:3e:d6:b0:16, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.network.neutron [req-1c108a54-fdcc-47e5-b740-0252875d170f req-ef14be87-64a9-41f5-bb11-3cc6e0d95d26 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Updated VIF entry in instance network info cache for port 30f13766-7037-4c15-82c7-4c1a2eb1f889. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG nova.network.neutron [req-1c108a54-fdcc-47e5-b740-0252875d170f req-ef14be87-64a9-41f5-bb11-3cc6e0d95d26 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Updating instance_info_cache with network_info: [{"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:23:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1c108a54-fdcc-47e5-b740-0252875d170f req-ef14be87-64a9-41f5-bb11-3cc6e0d95d26 service nova] Releasing lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:23:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-64188b9e-3976-40bc-ad98-25c90976648a req-72202fe4-3459-43ac-93a8-2b252a407bce service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Received event network-vif-plugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:23:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-64188b9e-3976-40bc-ad98-25c90976648a req-72202fe4-3459-43ac-93a8-2b252a407bce service nova] Acquiring lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:23:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-64188b9e-3976-40bc-ad98-25c90976648a req-72202fe4-3459-43ac-93a8-2b252a407bce service nova] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:23:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-64188b9e-3976-40bc-ad98-25c90976648a req-72202fe4-3459-43ac-93a8-2b252a407bce service nova] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:23:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-64188b9e-3976-40bc-ad98-25c90976648a req-72202fe4-3459-43ac-93a8-2b252a407bce service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] No waiting events found dispatching network-vif-plugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:23:15 user nova-compute[82184]: WARNING nova.compute.manager [req-64188b9e-3976-40bc-ad98-25c90976648a req-72202fe4-3459-43ac-93a8-2b252a407bce service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Received unexpected event network-vif-plugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 for instance with vm_state building and task_state spawning.
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266196.80438, 35de4fd0-e7b2-484c-b261-fca54a8103a8 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:23:16 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] VM Resumed (Lifecycle Event)
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:23:16 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Instance spawned successfully.
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:23:16 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266196.805746, 35de4fd0-e7b2-484c-b261-fca54a8103a8 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:23:16 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] VM Started (Lifecycle Event)
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:23:16 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:23:16 user nova-compute[82184]: INFO nova.compute.manager [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 12 02:23:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:23:16 user nova-compute[82184]: INFO nova.compute.manager [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Took 5.93 seconds to build instance.
Apr 12 02:23:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b6113477-9dd5-4db2-bc92-9586dadde0eb tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.020s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:23:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-aa57a443-180e-4bc2-ac86-9a99d76490b5 req-42f03dee-1cfd-4ac7-9e62-128b3fb3c338 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Received event network-vif-plugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:23:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aa57a443-180e-4bc2-ac86-9a99d76490b5 req-42f03dee-1cfd-4ac7-9e62-128b3fb3c338 service nova] Acquiring lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:23:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aa57a443-180e-4bc2-ac86-9a99d76490b5 req-42f03dee-1cfd-4ac7-9e62-128b3fb3c338 service nova] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:23:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-aa57a443-180e-4bc2-ac86-9a99d76490b5 req-42f03dee-1cfd-4ac7-9e62-128b3fb3c338 service nova] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:23:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-aa57a443-180e-4bc2-ac86-9a99d76490b5 req-42f03dee-1cfd-4ac7-9e62-128b3fb3c338 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] No waiting events found dispatching network-vif-plugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:23:17 user nova-compute[82184]: WARNING nova.compute.manager [req-aa57a443-180e-4bc2-ac86-9a99d76490b5 req-42f03dee-1cfd-4ac7-9e62-128b3fb3c338 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Received unexpected event network-vif-plugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 for instance with vm_state active and task_state None.
Apr 12 02:23:17 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:23:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:20 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:23:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:23:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:23:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:23:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:23:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:23:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:24:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:04 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:24:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:08 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:24:08 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:24:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:24:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:24:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:24:08 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:24:08 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-3643366b-06ac-4fab-ba60-fc786105fc8c req-c24487b8-d9bb-4aec-b436-e69b8ce72587 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-changed-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-3643366b-06ac-4fab-ba60-fc786105fc8c req-c24487b8-d9bb-4aec-b436-e69b8ce72587 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Refreshing instance network info cache due to event network-changed-00eb0800-cff6-4e7f-aa82-0103d8cc5153. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3643366b-06ac-4fab-ba60-fc786105fc8c req-c24487b8-d9bb-4aec-b436-e69b8ce72587 service nova] Acquiring lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3643366b-06ac-4fab-ba60-fc786105fc8c req-c24487b8-d9bb-4aec-b436-e69b8ce72587 service nova] Acquired lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG nova.network.neutron [req-3643366b-06ac-4fab-ba60-fc786105fc8c req-c24487b8-d9bb-4aec-b436-e69b8ce72587 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Refreshing network info cache for port 00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG nova.network.neutron [req-3643366b-06ac-4fab-ba60-fc786105fc8c req-c24487b8-d9bb-4aec-b436-e69b8ce72587 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updated VIF entry in instance network info cache for port 00eb0800-cff6-4e7f-aa82-0103d8cc5153. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG nova.network.neutron [req-3643366b-06ac-4fab-ba60-fc786105fc8c req-c24487b8-d9bb-4aec-b436-e69b8ce72587 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating instance_info_cache with network_info: [{"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:24:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3643366b-06ac-4fab-ba60-fc786105fc8c req-c24487b8-d9bb-4aec-b436-e69b8ce72587 service nova] Releasing lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-51a41141-20aa-4e13-b34d-f14f315bcea6 req-643583bb-1116-49a5-b52c-aa3f967954f9 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-changed-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.manager [req-51a41141-20aa-4e13-b34d-f14f315bcea6 req-643583bb-1116-49a5-b52c-aa3f967954f9 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Refreshing instance network info cache due to event network-changed-00eb0800-cff6-4e7f-aa82-0103d8cc5153. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-51a41141-20aa-4e13-b34d-f14f315bcea6 req-643583bb-1116-49a5-b52c-aa3f967954f9 service nova] Acquiring lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-51a41141-20aa-4e13-b34d-f14f315bcea6 req-643583bb-1116-49a5-b52c-aa3f967954f9 service nova] Acquired lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.network.neutron [req-51a41141-20aa-4e13-b34d-f14f315bcea6 req-643583bb-1116-49a5-b52c-aa3f967954f9 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Refreshing network info cache for port 00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:24:10 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:24:10 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8569MB free_disk=26.214824676513672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:24:10 user nova-compute[82184]: INFO nova.compute.manager [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Detaching volume 6f29ab89-68a0-4841-9a41-173da8724057
Apr 12 02:24:10 user nova-compute[82184]: INFO nova.virt.block_device [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Attempting to driver detach volume 6f29ab89-68a0-4841-9a41-173da8724057 from mountpoint /dev/vdb
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Attempting to detach device vdb from instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:24:10 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:24:10 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:24:10 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:24:10 user nova-compute[82184]:   <serial>6f29ab89-68a0-4841-9a41-173da8724057</serial>
Apr 12 02:24:10 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:24:10 user nova-compute[82184]: </disk>
Apr 12 02:24:10 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:24:10 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Successfully detached device vdb from instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f from the persistent domain config.
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:24:10 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:24:10 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:24:10 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:24:10 user nova-compute[82184]:   <serial>6f29ab89-68a0-4841-9a41-173da8724057</serial>
Apr 12 02:24:10 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:24:10 user nova-compute[82184]: </disk>
Apr 12 02:24:10 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.network.neutron [req-51a41141-20aa-4e13-b34d-f14f315bcea6 req-643583bb-1116-49a5-b52c-aa3f967954f9 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updated VIF entry in instance network info cache for port 00eb0800-cff6-4e7f-aa82-0103d8cc5153. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.network.neutron [req-51a41141-20aa-4e13-b34d-f14f315bcea6 req-643583bb-1116-49a5-b52c-aa3f967954f9 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating instance_info_cache with network_info: [{"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-51a41141-20aa-4e13-b34d-f14f315bcea6 req-643583bb-1116-49a5-b52c-aa3f967954f9 service nova] Releasing lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681266250.8823304, 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:24:10 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Successfully detached device vdb from instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f from the live domain config.
Apr 12 02:24:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exYFCQAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:24:10 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:24:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[789c58a3-f7ca-476a-8e38-a4464f6a859e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:24:10 user nova-compute[82184]: No targets found.
Apr 12 02:24:10 user nova-compute[82184]: iSNS:
Apr 12 02:24:10 user nova-compute[82184]: No targets found.
Apr 12 02:24:10 user nova-compute[82184]: STATIC:
Apr 12 02:24:10 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34
Apr 12 02:24:10 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:24:10 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:24:10 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057
Apr 12 02:24:10 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:24:10 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:24:10 user nova-compute[82184]: FIRMWARE:
Apr 12 02:24:10 user nova-compute[82184]: No targets found.
Apr 12 02:24:10 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:24:10 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:24:10 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[906d07c4-a38e-49d7-8a11-63d000ec9d15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d0b0d9-3cad-4f0b-b42f-dfe7ffa08623]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:24:10 user nova-compute[82184]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 (non-flash)
Apr 12 02:24:10 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:24:10 user nova-compute[82184]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 (non-flash)
Apr 12 02:24:10 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b73fc790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:24:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58649b0-b71c-48ff-8dd1-a7dc8b5129dc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d50678f-aecc-435e-9ac7-fc7f388dfcb6]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a00baa4-3dff-4c28-8bc8-642882c8aeca]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eba3cb-6b35-4634-a506-51ba961e6dc9]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d60260-9a45-4056-b2fb-557d685cc0db]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5718a1-381a-4408-9f12-3bddbf11103d]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057, portal: 172.16.0.220,3260]
Apr 12 02:24:11 user nova-compute[82184]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057, portal: 172.16.0.220,3260] successful.
Apr 12 02:24:11 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f29ab89-68a0-4841-9a41-173da8724057 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd97f5e7-b587-4163-ace9-e420927cd8a8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] <== disconnect_volume: return (320ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:24:11 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'flavor' on Instance uuid 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:24:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b70ffd83-c7d5-4f41-8b70-9c58396d11ab tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.692s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:24:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:24:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:24:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:24:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:24:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:24:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:24:13 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:24:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating instance_info_cache with network_info: [{"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:24:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:24:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:24:14 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:24:15 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:24:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:24:19 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:24:20 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:24:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:24:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:24:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:24:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:24:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:24:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:24:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:24:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:24:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:01 user nova-compute[82184]: DEBUG nova.compute.manager [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:25:01 user nova-compute[82184]: INFO nova.compute.manager [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] instance snapshotting
Apr 12 02:25:02 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Beginning live snapshot process
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json -f qcow2 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json -f qcow2 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.160s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmd2l5qqq/53f80776a01944f2b37f8fa008330f50.delta 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmd2l5qqq/53f80776a01944f2b37f8fa008330f50.delta 1073741824" returned: 0 in 0.055s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:02 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:25:02 user nova-compute[82184]: INFO nova.compute.manager [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Terminating instance
Apr 12 02:25:02 user nova-compute[82184]: DEBUG nova.compute.manager [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:25:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-b06966d4-484b-45fa-b1b1-2fd1e2ac323a req-22f44b71-d4a8-40f6-8e8f-26a808e06255 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-vif-unplugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b06966d4-484b-45fa-b1b1-2fd1e2ac323a req-22f44b71-d4a8-40f6-8e8f-26a808e06255 service nova] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b06966d4-484b-45fa-b1b1-2fd1e2ac323a req-22f44b71-d4a8-40f6-8e8f-26a808e06255 service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b06966d4-484b-45fa-b1b1-2fd1e2ac323a req-22f44b71-d4a8-40f6-8e8f-26a808e06255 service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-b06966d4-484b-45fa-b1b1-2fd1e2ac323a req-22f44b71-d4a8-40f6-8e8f-26a808e06255 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] No waiting events found dispatching network-vif-unplugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-b06966d4-484b-45fa-b1b1-2fd1e2ac323a req-22f44b71-d4a8-40f6-8e8f-26a808e06255 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-vif-unplugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:03 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Instance destroyed successfully.
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.objects.instance [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lazy-loading 'resources' on Instance uuid 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:20:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-47460833',display_name='tempest-TestMinimumBasicScenario-server-47460833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-47460833',id=41,image_ref='b6ae0cea-7c74-495d-ae4c-3c01f51c692e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRiQvqoiry2HzQuAwe/Vgtc//3bwoA4G8ab1sp4euF4u2N4/2/yd2ZM5F60Io7Szs5Bjs3LQMxAsDKjmtd2F35MDF3acLGrWxj7gQuIphjSqqZuF6DF4p1A0yUIs40Gkg==',key_name='tempest-TestMinimumBasicScenario-930950318',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b73a0cde174feeb85558cebb13d137',ramdisk_id='',reservation_id='r-qroe61zy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6ae0cea-7c74-495d-ae4c-3c01f51c692e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-934200257',owner_user_name='tempest-TestMinimumBasicScenario-934200257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:22:25Z,user_data=None,user_id='88570fbc28654337a032da5fa1f58814',uuid=5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converting VIF {"id": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "address": "fa:16:3e:79:08:79", "network": {"id": "d62e0f89-6046-4a5f-9fda-0c742420c904", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-857178800-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b73a0cde174feeb85558cebb13d137", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00eb0800-cf", "ovs_interfaceid": "00eb0800-cff6-4e7f-aa82-0103d8cc5153", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:08:79,bridge_name='br-int',has_traffic_filtering=True,id=00eb0800-cff6-4e7f-aa82-0103d8cc5153,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00eb0800-cf') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG os_vif [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:08:79,bridge_name='br-int',has_traffic_filtering=True,id=00eb0800-cff6-4e7f-aa82-0103d8cc5153,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00eb0800-cf') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00eb0800-cf, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:03 user nova-compute[82184]: INFO os_vif [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:08:79,bridge_name='br-int',has_traffic_filtering=True,id=00eb0800-cff6-4e7f-aa82-0103d8cc5153,network=Network(d62e0f89-6046-4a5f-9fda-0c742420c904),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00eb0800-cf')
Apr 12 02:25:03 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Deleting instance files /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f_del
Apr 12 02:25:03 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Deletion of /opt/stack/data/nova/instances/5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f_del complete
Apr 12 02:25:03 user nova-compute[82184]: INFO nova.compute.manager [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Took 1.00 seconds to destroy the instance on the hypervisor.
Apr 12 02:25:03 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:25:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 02:25:03 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 02:25:04 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:25:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmd2l5qqq/53f80776a01944f2b37f8fa008330f50.delta /opt/stack/data/nova/instances/snapshots/tmpmd2l5qqq/53f80776a01944f2b37f8fa008330f50 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:04 user nova-compute[82184]: DEBUG nova.compute.manager [req-b5ba1d53-2b62-40db-9ce0-d2d1198ef708 req-8f928727-0861-456c-97d6-a4ee7e0913d1 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-vif-deleted-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:25:04 user nova-compute[82184]: INFO nova.compute.manager [req-b5ba1d53-2b62-40db-9ce0-d2d1198ef708 req-8f928727-0861-456c-97d6-a4ee7e0913d1 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Neutron deleted interface 00eb0800-cff6-4e7f-aa82-0103d8cc5153; detaching it from the instance and deleting it from the info cache
Apr 12 02:25:04 user nova-compute[82184]: DEBUG nova.network.neutron [req-b5ba1d53-2b62-40db-9ce0-d2d1198ef708 req-8f928727-0861-456c-97d6-a4ee7e0913d1 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:25:04 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:25:04 user nova-compute[82184]: DEBUG nova.compute.manager [req-b5ba1d53-2b62-40db-9ce0-d2d1198ef708 req-8f928727-0861-456c-97d6-a4ee7e0913d1 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Detach interface failed, port_id=00eb0800-cff6-4e7f-aa82-0103d8cc5153, reason: Instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 02:25:04 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Took 0.59 seconds to deallocate network for instance.
Apr 12 02:25:04 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmd2l5qqq/53f80776a01944f2b37f8fa008330f50.delta /opt/stack/data/nova/instances/snapshots/tmpmd2l5qqq/53f80776a01944f2b37f8fa008330f50" returned: 0 in 0.478s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:04 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Snapshot extracted, beginning image upload
Apr 12 02:25:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:25:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:25:04 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:25:04 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:25:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:25:04 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Deleted allocations for instance 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f
Apr 12 02:25:04 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-5ae9755f-7269-4478-9c8f-212b2b59d199 tempest-TestMinimumBasicScenario-934200257 tempest-TestMinimumBasicScenario-934200257-project-member] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:25:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-cbc31298-c6d7-4d2f-a717-48313e7931b5 req-bae54445-833b-4bb8-9c1a-effd5bdb3aa8 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:25:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cbc31298-c6d7-4d2f-a717-48313e7931b5 req-bae54445-833b-4bb8-9c1a-effd5bdb3aa8 service nova] Acquiring lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:25:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cbc31298-c6d7-4d2f-a717-48313e7931b5 req-bae54445-833b-4bb8-9c1a-effd5bdb3aa8 service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:25:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-cbc31298-c6d7-4d2f-a717-48313e7931b5 req-bae54445-833b-4bb8-9c1a-effd5bdb3aa8 service nova] Lock "5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:25:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-cbc31298-c6d7-4d2f-a717-48313e7931b5 req-bae54445-833b-4bb8-9c1a-effd5bdb3aa8 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] No waiting events found dispatching network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:25:05 user nova-compute[82184]: WARNING nova.compute.manager [req-cbc31298-c6d7-4d2f-a717-48313e7931b5 req-bae54445-833b-4bb8-9c1a-effd5bdb3aa8 service nova] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Received unexpected event network-vif-plugged-00eb0800-cff6-4e7f-aa82-0103d8cc5153 for instance with vm_state deleted and task_state None.
Apr 12 02:25:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:25:06 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Snapshot image upload complete
Apr 12 02:25:06 user nova-compute[82184]: INFO nova.compute.manager [None req-053fd2ff-fc83-49b2-904f-2fb19732cec1 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Took 4.63 seconds to snapshot the instance on the hypervisor.
Apr 12 02:25:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:09 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:25:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:25:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:25:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:25:09 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:25:09 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:25:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:10 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:25:10 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:25:10 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8632MB free_disk=26.197566986083984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:25:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:25:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:25:11 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:25:11 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:25:11 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:25:11 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:25:11 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:25:11 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:25:11 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:25:11 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:25:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:25:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:25:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:25:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:25:14 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:25:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:25:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:25:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:25:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:25:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:25:14 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 3036c0b5-7987-4ff5-9edf-ee7397cf7beb {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:25:15 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updating instance_info_cache with network_info: [{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:25:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:25:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:25:15 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:25:15 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:25:18 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681266303.7388685, 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:25:18 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] VM Stopped (Lifecycle Event)
Apr 12 02:25:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d61c0588-0fb0-4457-8a22-820288ed4814 None None] [instance: 5c91bc86-0510-4114-a2ba-9e3f6b3a5e6f] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:25:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:25:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:25:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:25:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:25:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:25:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:25:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:25:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:25:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:25:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:25:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:25:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:25:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:25:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:25:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Verify base images {{(pid=82184) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Image id 16f93c82-82f4-4843-b632-b6b6fe0b6c16 yields fingerprint 95f71f969739e39e07ee6197f212e1b4213ce690 {{(pid=82184) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 02:25:36 user nova-compute[82184]: INFO nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] image 16f93c82-82f4-4843-b632-b6b6fe0b6c16 at (/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690): checking
Apr 12 02:25:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] image 16f93c82-82f4-4843-b632-b6b6fe0b6c16 at (/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690): image is in use {{(pid=82184) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=82184) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] 35de4fd0-e7b2-484c-b261-fca54a8103a8 is a valid instance name {{(pid=82184) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] 35de4fd0-e7b2-484c-b261-fca54a8103a8 has a disk file {{(pid=82184) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 is backed by 95f71f969739e39e07ee6197f212e1b4213ce690 {{(pid=82184) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] 811c4fb7-d984-461e-9190-4d0e9ec345c2 is a valid instance name {{(pid=82184) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] 3036c0b5-7987-4ff5-9edf-ee7397cf7beb is a valid instance name {{(pid=82184) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] 3036c0b5-7987-4ff5-9edf-ee7397cf7beb has a disk file {{(pid=82184) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 02:25:36 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:25:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:25:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb is backed by 95f71f969739e39e07ee6197f212e1b4213ce690 {{(pid=82184) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 02:25:37 user nova-compute[82184]: WARNING nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Unknown base file: /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0
Apr 12 02:25:37 user nova-compute[82184]: WARNING nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493
Apr 12 02:25:37 user nova-compute[82184]: WARNING nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d
Apr 12 02:25:37 user nova-compute[82184]: WARNING nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7
Apr 12 02:25:37 user nova-compute[82184]: WARNING nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Unknown base file: /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b
Apr 12 02:25:37 user nova-compute[82184]: INFO nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Active base files: /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690
Apr 12 02:25:37 user nova-compute[82184]: INFO nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Removable base files: /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0 /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493 /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7 /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b
Apr 12 02:25:37 user nova-compute[82184]: INFO nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/05066d1209cdc5effee2113fba12d887d85fd1e0
Apr 12 02:25:37 user nova-compute[82184]: INFO nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8418b8183a766d5e1140be654e99d292e93a0493
Apr 12 02:25:37 user nova-compute[82184]: INFO nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cb0afa43b2ac5a66ab3741ac6870714d3b63fe3d
Apr 12 02:25:37 user nova-compute[82184]: INFO nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1103d5c417a34a44967ed796c77ea479389209f7
Apr 12 02:25:37 user nova-compute[82184]: INFO nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/df0a6e7b56c610af6e1269e781d9618eeb6e699b
Apr 12 02:25:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Verification complete {{(pid=82184) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 12 02:25:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Verify swap images {{(pid=82184) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 12 02:25:37 user nova-compute[82184]: DEBUG nova.virt.libvirt.imagecache [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Verify ephemeral images {{(pid=82184) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 12 02:25:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:25:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:25:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:25:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:26:09 user nova-compute[82184]: INFO nova.compute.claims [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Claim successful on node user
Apr 12 02:26:09 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:26:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:26:09 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:26:09 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:26:09 user nova-compute[82184]: INFO nova.virt.block_device [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Booting with volume-backed-image 16f93c82-82f4-4843-b632-b6b6fe0b6c16 at /dev/vda
Apr 12 02:26:09 user nova-compute[82184]: DEBUG nova.policy [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe9217f4c1ff428086140b7fd07194eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb951049b464316a04647ce9c52963a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:26:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Successfully created port: 10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:26:10 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:26:10 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:26:10 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Successfully updated port: 10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG nova.compute.manager [req-a0fbb50a-5c75-44a7-9945-81db03adccd3 req-7f000382-ebec-49d9-9203-4eea9cc77de4 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-changed-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG nova.compute.manager [req-a0fbb50a-5c75-44a7-9945-81db03adccd3 req-7f000382-ebec-49d9-9203-4eea9cc77de4 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Refreshing instance network info cache due to event network-changed-10e7ad4b-208f-4fee-bdd3-2f9c98e34853. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0fbb50a-5c75-44a7-9945-81db03adccd3 req-7f000382-ebec-49d9-9203-4eea9cc77de4 service nova] Acquiring lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0fbb50a-5c75-44a7-9945-81db03adccd3 req-7f000382-ebec-49d9-9203-4eea9cc77de4 service nova] Acquired lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-a0fbb50a-5c75-44a7-9945-81db03adccd3 req-7f000382-ebec-49d9-9203-4eea9cc77de4 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Refreshing network info cache for port 10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-a0fbb50a-5c75-44a7-9945-81db03adccd3 req-7f000382-ebec-49d9-9203-4eea9cc77de4 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-a0fbb50a-5c75-44a7-9945-81db03adccd3 req-7f000382-ebec-49d9-9203-4eea9cc77de4 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a0fbb50a-5c75-44a7-9945-81db03adccd3 req-7f000382-ebec-49d9-9203-4eea9cc77de4 service nova] Releasing lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquired lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:11 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:26:11 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:26:11 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8661MB free_disk=26.22591781616211GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e9b52057-9ce7-42c0-ae32-1c01cf92ce39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Updating instance_info_cache with network_info: [{"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Releasing lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Instance network_info: |[{"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:26:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:26:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:26:14 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:26:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:26:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:26:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG os_brick.utils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8ad362-e515-4d5d-88ad-a2462ad3e649]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6ee46a-a78a-49ba-84f0-3b6de1aa3cba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[df07f7ed-f509-42dd-8e39-83e0591ae40a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[65999805-5268-4ee2-b81f-e49e3618b15f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updating instance_info_cache with network_info: [{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:26:15 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:26:15 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef43a05a-fe00-4eb0-bf48-244fdf8e7310]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG os_brick.utils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:26:15 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Updating existing volume attachment record: 0b711017-d759-43c6-beec-6d6bf83266c1 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:26:16 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:16 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:16 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:26:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Creating image(s)
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Did not create local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Ensure instance console log exists: /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Start _get_guest_xml network_info=[{"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '0b711017-d759-43c6-beec-6d6bf83266c1', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaKSbLnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9b52057-9ce7-42c0-ae32-1c01cf92ce39', 'attached_at': '', 'detached_at': '', 'volume_id': '53de24a4-e555-4257-b102-ea6d2d173d04', 'serial': '53de24a4-e555-4257-b102-ea6d2d173d04'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:26:19 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:26:19 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaKSbLnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:26:19 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:26:19 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:26:19 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03b5e2d-2211-49cd-a9aa-4fcd39b82183]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:26:19 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eaaae4-2802-4434-a48b-e1db5c85e173]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04] added
Apr 12 02:26:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04d35ea-e495-4ce8-9fd9-c050e1852d2b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df5ea85-59c7-498b-87d0-14606b98abe9]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaKSbLnr {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaKSbLnr" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd41abbd-d4ec-4600-ad64-7796134d09a3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AaKSbLnr'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d13bee6-4072-4799-a5d1-1f6da7d1ea23]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e23ed50-77d1-4b7a-9de9-ebf7c65fc431]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:26:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:26:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe091b3-c6be-4170-8e1a-999b467859f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04, portal: 172.16.0.220,3260]
Apr 12 02:26:19 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04, portal: 172.16.0.220,3260] successful.
Apr 12 02:26:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be235ed-7404-4b2c-9d27-679c954af4c8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d214ed2-59dc-44ed-8079-a1a5c4010cba]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:26:19 user nova-compute[82184]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 (non-flash)
Apr 12 02:26:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:26:19 user nova-compute[82184]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 (non-flash)
Apr 12 02:26:19 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:26:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:26:20 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:26:20 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4003ee46-e605-4767-9807-65b77598a588]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:26:20 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaKSbLnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26433313030646635', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433313030646635', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1066136151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1066136151',id=43,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-zfudcdgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:26:10Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=e9b52057-9ce7-42c0-ae32-1c01cf92ce39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:8c:bf,bridge_name='br-int',has_traffic_filtering=True,id=10e7ad4b-208f-4fee-bdd3-2f9c98e34853,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e7ad4b-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.objects.instance [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'pci_devices' on Instance uuid e9b52057-9ce7-42c0-ae32-1c01cf92ce39 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:26:21 user nova-compute[82184]:   <uuid>e9b52057-9ce7-42c0-ae32-1c01cf92ce39</uuid>
Apr 12 02:26:21 user nova-compute[82184]:   <name>instance-0000002b</name>
Apr 12 02:26:21 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:26:21 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:26:21 user nova-compute[82184]:   <metadata>
Apr 12 02:26:21 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:26:21 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:26:21 user nova-compute[82184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1066136151</nova:name>
Apr 12 02:26:21 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:26:19</nova:creationTime>
Apr 12 02:26:21 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:26:21 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:26:21 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:26:21 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:26:21 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:26:21 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:26:21 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:26:21 user nova-compute[82184]:       <nova:owner>
Apr 12 02:26:21 user nova-compute[82184]:         <nova:user uuid="fe9217f4c1ff428086140b7fd07194eb">tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member</nova:user>
Apr 12 02:26:21 user nova-compute[82184]:         <nova:project uuid="6bb951049b464316a04647ce9c52963a">tempest-ServerBootFromVolumeStableRescueTest-1070279577</nova:project>
Apr 12 02:26:21 user nova-compute[82184]:       </nova:owner>
Apr 12 02:26:21 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:26:21 user nova-compute[82184]:       <nova:ports>
Apr 12 02:26:21 user nova-compute[82184]:         <nova:port uuid="10e7ad4b-208f-4fee-bdd3-2f9c98e34853">
Apr 12 02:26:21 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 02:26:21 user nova-compute[82184]:         </nova:port>
Apr 12 02:26:21 user nova-compute[82184]:       </nova:ports>
Apr 12 02:26:21 user nova-compute[82184]:     </nova:instance>
Apr 12 02:26:21 user nova-compute[82184]:   </metadata>
Apr 12 02:26:21 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:26:21 user nova-compute[82184]:     <system>
Apr 12 02:26:21 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:26:21 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:26:21 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:26:21 user nova-compute[82184]:       <entry name="serial">e9b52057-9ce7-42c0-ae32-1c01cf92ce39</entry>
Apr 12 02:26:21 user nova-compute[82184]:       <entry name="uuid">e9b52057-9ce7-42c0-ae32-1c01cf92ce39</entry>
Apr 12 02:26:21 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:26:21 user nova-compute[82184]:     </system>
Apr 12 02:26:21 user nova-compute[82184]:   </sysinfo>
Apr 12 02:26:21 user nova-compute[82184]:   <os>
Apr 12 02:26:21 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:26:21 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:26:21 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:26:21 user nova-compute[82184]:   </os>
Apr 12 02:26:21 user nova-compute[82184]:   <features>
Apr 12 02:26:21 user nova-compute[82184]:     <acpi/>
Apr 12 02:26:21 user nova-compute[82184]:     <apic/>
Apr 12 02:26:21 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:26:21 user nova-compute[82184]:   </features>
Apr 12 02:26:21 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:26:21 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:26:21 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:26:21 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:26:21 user nova-compute[82184]:   </clock>
Apr 12 02:26:21 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:26:21 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:26:21 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:26:21 user nova-compute[82184]:   </cpu>
Apr 12 02:26:21 user nova-compute[82184]:   <devices>
Apr 12 02:26:21 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:26:21 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:26:21 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 02:26:21 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:26:21 user nova-compute[82184]:       <serial>53de24a4-e555-4257-b102-ea6d2d173d04</serial>
Apr 12 02:26:21 user nova-compute[82184]:     </disk>
Apr 12 02:26:21 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:26:21 user nova-compute[82184]:       <mac address="fa:16:3e:68:8c:bf"/>
Apr 12 02:26:21 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:26:21 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:26:21 user nova-compute[82184]:       <target dev="tap10e7ad4b-20"/>
Apr 12 02:26:21 user nova-compute[82184]:     </interface>
Apr 12 02:26:21 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:26:21 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/console.log" append="off"/>
Apr 12 02:26:21 user nova-compute[82184]:     </serial>
Apr 12 02:26:21 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:26:21 user nova-compute[82184]:     <video>
Apr 12 02:26:21 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:26:21 user nova-compute[82184]:     </video>
Apr 12 02:26:21 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:26:21 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:26:21 user nova-compute[82184]:     </rng>
Apr 12 02:26:21 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:26:21 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:26:21 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:26:21 user nova-compute[82184]:     </memballoon>
Apr 12 02:26:21 user nova-compute[82184]:   </devices>
Apr 12 02:26:21 user nova-compute[82184]: </domain>
Apr 12 02:26:21 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1066136151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1066136151',id=43,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-zfudcdgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:26:10Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=e9b52057-9ce7-42c0-ae32-1c01cf92ce39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:8c:bf,bridge_name='br-int',has_traffic_filtering=True,id=10e7ad4b-208f-4fee-bdd3-2f9c98e34853,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e7ad4b-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG os_vif [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:8c:bf,bridge_name='br-int',has_traffic_filtering=True,id=10e7ad4b-208f-4fee-bdd3-2f9c98e34853,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e7ad4b-20') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10e7ad4b-20, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10e7ad4b-20, col_values=(('external_ids', {'iface-id': '10e7ad4b-208f-4fee-bdd3-2f9c98e34853', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:8c:bf', 'vm-uuid': 'e9b52057-9ce7-42c0-ae32-1c01cf92ce39'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:21 user nova-compute[82184]: INFO os_vif [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:8c:bf,bridge_name='br-int',has_traffic_filtering=True,id=10e7ad4b-208f-4fee-bdd3-2f9c98e34853,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e7ad4b-20')
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:26:21 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No VIF found with MAC fa:16:3e:68:8c:bf, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:26:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-b3855ba3-6f64-4da2-aca0-900f6c4e341d req-7f69322c-c744-454f-8f89-91565d3399ac service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:26:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b3855ba3-6f64-4da2-aca0-900f6c4e341d req-7f69322c-c744-454f-8f89-91565d3399ac service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b3855ba3-6f64-4da2-aca0-900f6c4e341d req-7f69322c-c744-454f-8f89-91565d3399ac service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b3855ba3-6f64-4da2-aca0-900f6c4e341d req-7f69322c-c744-454f-8f89-91565d3399ac service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:26:22 user nova-compute[82184]: DEBUG nova.compute.manager [req-b3855ba3-6f64-4da2-aca0-900f6c4e341d req-7f69322c-c744-454f-8f89-91565d3399ac service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:26:22 user nova-compute[82184]: WARNING nova.compute.manager [req-b3855ba3-6f64-4da2-aca0-900f6c4e341d req-7f69322c-c744-454f-8f89-91565d3399ac service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state building and task_state spawning.
Apr 12 02:26:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:23 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:23 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266384.6982594, e9b52057-9ce7-42c0-ae32-1c01cf92ce39 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:26:24 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] VM Resumed (Lifecycle Event)
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:26:24 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Instance spawned successfully.
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.compute.manager [req-d980f70e-056c-413d-a4d0-d98825f525b8 req-4aa66573-b235-40ce-b85e-f98f161b7b6b service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d980f70e-056c-413d-a4d0-d98825f525b8 req-4aa66573-b235-40ce-b85e-f98f161b7b6b service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d980f70e-056c-413d-a4d0-d98825f525b8 req-4aa66573-b235-40ce-b85e-f98f161b7b6b service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d980f70e-056c-413d-a4d0-d98825f525b8 req-4aa66573-b235-40ce-b85e-f98f161b7b6b service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.compute.manager [req-d980f70e-056c-413d-a4d0-d98825f525b8 req-4aa66573-b235-40ce-b85e-f98f161b7b6b service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:26:24 user nova-compute[82184]: WARNING nova.compute.manager [req-d980f70e-056c-413d-a4d0-d98825f525b8 req-4aa66573-b235-40ce-b85e-f98f161b7b6b service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state building and task_state spawning.
Apr 12 02:26:24 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266384.699567, e9b52057-9ce7-42c0-ae32-1c01cf92ce39 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:26:24 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] VM Started (Lifecycle Event)
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:26:24 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:26:24 user nova-compute[82184]: INFO nova.compute.manager [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Took 5.17 seconds to spawn the instance on the hypervisor.
Apr 12 02:26:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:26:24 user nova-compute[82184]: INFO nova.compute.manager [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Took 15.82 seconds to build instance.
Apr 12 02:26:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cf029979-b3f1-41c7-a22e-fa511c316fec tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.928s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:26:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:26:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:26:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:26:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:26:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:26:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:26:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 3036c0b5-7987-4ff5-9edf-ee7397cf7beb {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 811c4fb7-d984-461e-9190-4d0e9ec345c2 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 35de4fd0-e7b2-484c-b261-fca54a8103a8 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid e9b52057-9ce7-42c0-ae32-1c01cf92ce39 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "35de4fd0-e7b2-484c-b261-fca54a8103a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:26:57 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:27:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:27:05 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:27:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:27:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:27:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:27:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:27:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:27:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:27:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:27:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:27:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:27:11 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:27:11 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:27:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:27:12 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:27:12 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:27:12 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8627MB free_disk=26.224266052246094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:27:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e9b52057-9ce7-42c0-ae32-1c01cf92ce39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:27:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:27:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:16 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:27:16 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:27:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:27:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:27:16 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:27:17 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Updating instance_info_cache with network_info: [{"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:27:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:27:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:27:17 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:27:17 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:27:18 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:27:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:27:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:27:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:27:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:27:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:24 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:27:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:27:25 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:27:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:27:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:27:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:27:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:27:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:27:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:27:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:27:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:27:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:27:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:27:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:27:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:27:59 user nova-compute[82184]: INFO nova.compute.manager [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Rescuing
Apr 12 02:27:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:27:59 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquired lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:27:59 user nova-compute[82184]: DEBUG nova.network.neutron [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:28:00 user nova-compute[82184]: DEBUG nova.network.neutron [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Updating instance_info_cache with network_info: [{"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:28:00 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Releasing lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:28:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-3808eeff-2b7f-445a-9b82-f70bfe8193ba req-de599b47-fb59-4371-8cef-89b26edd5514 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3808eeff-2b7f-445a-9b82-f70bfe8193ba req-de599b47-fb59-4371-8cef-89b26edd5514 service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3808eeff-2b7f-445a-9b82-f70bfe8193ba req-de599b47-fb59-4371-8cef-89b26edd5514 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3808eeff-2b7f-445a-9b82-f70bfe8193ba req-de599b47-fb59-4371-8cef-89b26edd5514 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG nova.compute.manager [req-3808eeff-2b7f-445a-9b82-f70bfe8193ba req-de599b47-fb59-4371-8cef-89b26edd5514 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:28:01 user nova-compute[82184]: WARNING nova.compute.manager [req-3808eeff-2b7f-445a-9b82-f70bfe8193ba req-de599b47-fb59-4371-8cef-89b26edd5514 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state active and task_state rescuing.
Apr 12 02:28:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:01 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Instance destroyed successfully.
Apr 12 02:28:01 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Attempting a stable device rescue
Apr 12 02:28:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82184) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Instance directory exists: not creating {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 02:28:01 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Creating image(s)
Apr 12 02:28:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "/opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "/opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG nova.objects.instance [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'trusted_certs' on Instance uuid e9b52057-9ce7-42c0-ae32-1c01cf92ce39 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "b58314a55b72548531f6b0fd9455978fd0f65145" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:01 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "b58314a55b72548531f6b0fd9455978fd0f65145" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145.part --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145.part --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:02 user nova-compute[82184]: DEBUG nova.virt.images [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] 14b68404-a3f6-4c9b-be99-7ca9303c3776 was qcow2, converting to raw {{(pid=82184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 02:28:02 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:28:02 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145.part /opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145.converted {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145.part /opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145.converted" returned: 0 in 0.479s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145.converted --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:28:03 user nova-compute[82184]: WARNING nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state active and task_state rescuing.
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:28:03 user nova-compute[82184]: WARNING nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state active and task_state rescuing.
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:28:03 user nova-compute[82184]: WARNING nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state active and task_state rescuing.
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:28:03 user nova-compute[82184]: WARNING nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state active and task_state rescuing.
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:28:03 user nova-compute[82184]: WARNING nova.compute.manager [req-5f9fb3e5-3df7-4b15-8b08-187f9bb52832 req-095a53d1-b387-4116-972e-0b163ae0c63a service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state active and task_state rescuing.
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "b58314a55b72548531f6b0fd9455978fd0f65145" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.723s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "b58314a55b72548531f6b0fd9455978fd0f65145" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "b58314a55b72548531f6b0fd9455978fd0f65145" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145 --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145,backing_fmt=raw /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b58314a55b72548531f6b0fd9455978fd0f65145,backing_fmt=raw /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue" returned: 0 in 0.056s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "b58314a55b72548531f6b0fd9455978fd0f65145" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.objects.instance [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'migration_context' on Instance uuid e9b52057-9ce7-42c0-ae32-1c01cf92ce39 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Start _get_guest_xml network_info=[{"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "vif_mac": "fa:16:3e:68:8c:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '14b68404-a3f6-4c9b-be99-7ca9303c3776', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'attachment_id': '0b711017-d759-43c6-beec-6d6bf83266c1', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaKSbLnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e9b52057-9ce7-42c0-ae32-1c01cf92ce39', 'attached_at': '', 'detached_at': '', 'volume_id': '53de24a4-e555-4257-b102-ea6d2d173d04', 'serial': '53de24a4-e555-4257-b102-ea6d2d173d04'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.objects.instance [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'resources' on Instance uuid e9b52057-9ce7-42c0-ae32-1c01cf92ce39 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.objects.instance [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'numa_topology' on Instance uuid e9b52057-9ce7-42c0-ae32-1c01cf92ce39 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:28:03 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:28:03 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.objects.instance [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'vcpu_model' on Instance uuid e9b52057-9ce7-42c0-ae32-1c01cf92ce39 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaKSbLnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:28:03 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:28:03 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:28:03 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c41ba91-8d68-4ba5-9ab1-6bd7ed336e8d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = AaKSbLnr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 02:28:03 user nova-compute[82184]: node.name = iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04
Apr 12 02:28:03 user nova-compute[82184]: node.tpgt = -1
Apr 12 02:28:03 user nova-compute[82184]: node.startup = automatic
Apr 12 02:28:03 user nova-compute[82184]: node.leading_login = No
Apr 12 02:28:03 user nova-compute[82184]: iface.iscsi_ifacename = default
Apr 12 02:28:03 user nova-compute[82184]: iface.net_ifacename = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.ipaddress = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.prefix_len = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.hwaddress = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.transport_name = tcp
Apr 12 02:28:03 user nova-compute[82184]: iface.initiatorname = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.state = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.vlan_id = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.vlan_priority = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.vlan_state = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.iface_num = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.mtu = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.port = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.bootproto = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.subnet_mask = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.gateway = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.dhcp_alt_client_id = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.dhcp_dns = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.dhcp_learn_iqn = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.dhcp_vendor_id_state = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.dhcp_vendor_id = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.dhcp_slp_da = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.fragmentation = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.gratuitous_arp = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.incoming_forwarding = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.tos_state = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.tos = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.ttl = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.delayed_ack = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.tcp_nagle = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.tcp_wsf_state = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.tcp_wsf = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.tcp_timer_scale = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.tcp_timestamp = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.redirect = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.def_task_mgmt_timeout = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.header_digest = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.data_digest = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.immediate_data = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.initial_r2t = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.data_seq_inorder = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.data_pdu_inorder = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.erl = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.max_receive_data_len = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.first_burst_len = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.max_outstanding_r2t = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.max_burst_len = 0
Apr 12 02:28:03 user nova-compute[82184]: iface.chap_auth = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.bidi_chap = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.strict_login_compliance = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.discovery_auth = <empty>
Apr 12 02:28:03 user nova-compute[82184]: iface.discovery_logout = <empty>
Apr 12 02:28:03 user nova-compute[82184]: node.discovery_address = <empty>
Apr 12 02:28:03 user nova-compute[82184]: node.discovery_port = 0
Apr 12 02:28:03 user nova-compute[82184]: node.discovery_type = static
Apr 12 02:28:03 user nova-compute[82184]: node.session.initial_cmdsn = 0
Apr 12 02:28:03 user nova-compute[82184]: node.session.initial_login_retry_max = 8
Apr 12 02:28:03 user nova-compute[82184]: node.session.xmit_thread_priority = -20
Apr 12 02:28:03 user nova-compute[82184]: node.session.cmds_max = 128
Apr 12 02:28:03 user nova-compute[82184]: node.session.queue_depth = 32
Apr 12 02:28:03 user nova-compute[82184]: node.session.nr_sessions = 1
Apr 12 02:28:03 user nova-compute[82184]: node.session.auth.authmethod = CHAP
Apr 12 02:28:03 user nova-compute[82184]: node.session.auth.username = AaKSbLnr
Apr 12 02:28:03 user nova-compute[82184]: node.session.auth.password = ***
Apr 12 02:28:03 user nova-compute[82184]: node.session.auth.username_in = <empty>
Apr 12 02:28:03 user nova-compute[82184]: node.session.auth.password_in = <empty>
Apr 12 02:28:03 user nova-compute[82184]: node.session.auth.chap_algs = MD5
Apr 12 02:28:03 user nova-compute[82184]: node.session.timeo.replacement_timeout = 120
Apr 12 02:28:03 user nova-compute[82184]: node.session.err_timeo.abort_timeout = 15
Apr 12 02:28:03 user nova-compute[82184]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 02:28:03 user nova-compute[82184]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 02:28:03 user nova-compute[82184]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 02:28:03 user nova-compute[82184]: node.session.iscsi.FastAbort = Yes
Apr 12 02:28:03 user nova-compute[82184]: node.session.iscsi.InitialR2T = No
Apr 12 02:28:03 user nova-compute[82184]: node.session.iscsi.ImmediateData = Yes
Apr 12 02:28:03 user nova-compute[82184]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 02:28:03 user nova-compute[82184]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 02:28:03 user nova-compute[82184]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 02:28:03 user nova-compute[82184]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 02:28:03 user nova-compute[82184]: node.session.iscsi.MaxConnections = 1
Apr 12 02:28:03 user nova-compute[82184]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 02:28:03 user nova-compute[82184]: node.session.iscsi.ERL = 0
Apr 12 02:28:03 user nova-compute[82184]: node.session.scan = manual
Apr 12 02:28:03 user nova-compute[82184]: node.session.reopen_max = 0
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].address = 172.16.0.220
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].port = 3260
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].startup = manual
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].tcp.window_size = 524288
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].tcp.type_of_service = 0
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].timeo.logout_timeout = 15
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].timeo.login_timeout = 15
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].timeo.auth_timeout = 45
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].iscsi.DataDigest = None
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].iscsi.IFMarker = No
Apr 12 02:28:03 user nova-compute[82184]: node.conn[0].iscsi.OFMarker = No
Apr 12 02:28:03 user nova-compute[82184]: # END RECORD
Apr 12 02:28:03 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fbd723-f017-4381-b125-b3f459b8ca0e]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a00853-0bbf-4d21-8bd2-c329030fe8d5]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaKSbLnr {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AaKSbLnr" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6877b7ce-d8ec-4189-8aec-7f949902576d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AaKSbLnr'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdea1fa6-6649-4c3f-976f-8debb44a4b57]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8525d0ab-756e-495e-80ac-2c81c0833c42]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:28:03 user nova-compute[82184]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 (non-flash)
Apr 12 02:28:03 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:28:03 user nova-compute[82184]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 (non-flash)
Apr 12 02:28:03 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.175s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] HCTL ('33', '0', '0', 0) found on session 51 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a622fce1-6a26-4905-8f2e-e20eca917608]: (4, ('0 0 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Searching for a device in session 51 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaKSbLnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.209s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] <== connect_volume: return (210ms) {'type': 'block', 'scsi_wwn': '26433313030646635', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433313030646635', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1066136151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1066136151',id=43,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:26:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-zfudcdgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:26:25Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=e9b52057-9ce7-42c0-ae32-1c01cf92ce39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "vif_mac": "fa:16:3e:68:8c:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "vif_mac": "fa:16:3e:68:8c:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:8c:bf,bridge_name='br-int',has_traffic_filtering=True,id=10e7ad4b-208f-4fee-bdd3-2f9c98e34853,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e7ad4b-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.objects.instance [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'pci_devices' on Instance uuid e9b52057-9ce7-42c0-ae32-1c01cf92ce39 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:28:03 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:28:03 user nova-compute[82184]:   <uuid>e9b52057-9ce7-42c0-ae32-1c01cf92ce39</uuid>
Apr 12 02:28:03 user nova-compute[82184]:   <name>instance-0000002b</name>
Apr 12 02:28:03 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:28:03 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:28:03 user nova-compute[82184]:   <metadata>
Apr 12 02:28:03 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:28:03 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:28:03 user nova-compute[82184]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1066136151</nova:name>
Apr 12 02:28:03 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:28:03</nova:creationTime>
Apr 12 02:28:03 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:28:03 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:28:03 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:28:03 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:28:03 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:28:03 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:28:03 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:28:03 user nova-compute[82184]:       <nova:owner>
Apr 12 02:28:03 user nova-compute[82184]:         <nova:user uuid="fe9217f4c1ff428086140b7fd07194eb">tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member</nova:user>
Apr 12 02:28:03 user nova-compute[82184]:         <nova:project uuid="6bb951049b464316a04647ce9c52963a">tempest-ServerBootFromVolumeStableRescueTest-1070279577</nova:project>
Apr 12 02:28:03 user nova-compute[82184]:       </nova:owner>
Apr 12 02:28:03 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:28:03 user nova-compute[82184]:       <nova:ports>
Apr 12 02:28:03 user nova-compute[82184]:         <nova:port uuid="10e7ad4b-208f-4fee-bdd3-2f9c98e34853">
Apr 12 02:28:03 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 02:28:03 user nova-compute[82184]:         </nova:port>
Apr 12 02:28:03 user nova-compute[82184]:       </nova:ports>
Apr 12 02:28:03 user nova-compute[82184]:     </nova:instance>
Apr 12 02:28:03 user nova-compute[82184]:   </metadata>
Apr 12 02:28:03 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:28:03 user nova-compute[82184]:     <system>
Apr 12 02:28:03 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:28:03 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:28:03 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:28:03 user nova-compute[82184]:       <entry name="serial">e9b52057-9ce7-42c0-ae32-1c01cf92ce39</entry>
Apr 12 02:28:03 user nova-compute[82184]:       <entry name="uuid">e9b52057-9ce7-42c0-ae32-1c01cf92ce39</entry>
Apr 12 02:28:03 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:28:03 user nova-compute[82184]:     </system>
Apr 12 02:28:03 user nova-compute[82184]:   </sysinfo>
Apr 12 02:28:03 user nova-compute[82184]:   <os>
Apr 12 02:28:03 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:28:03 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:28:03 user nova-compute[82184]:   </os>
Apr 12 02:28:03 user nova-compute[82184]:   <features>
Apr 12 02:28:03 user nova-compute[82184]:     <acpi/>
Apr 12 02:28:03 user nova-compute[82184]:     <apic/>
Apr 12 02:28:03 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:28:03 user nova-compute[82184]:   </features>
Apr 12 02:28:03 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:28:03 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:28:03 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:28:03 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:28:03 user nova-compute[82184]:   </clock>
Apr 12 02:28:03 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:28:03 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:28:03 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:28:03 user nova-compute[82184]:   </cpu>
Apr 12 02:28:03 user nova-compute[82184]:   <devices>
Apr 12 02:28:03 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:28:03 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:28:03 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 02:28:03 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:28:03 user nova-compute[82184]:       <serial>53de24a4-e555-4257-b102-ea6d2d173d04</serial>
Apr 12 02:28:03 user nova-compute[82184]:     </disk>
Apr 12 02:28:03 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:28:03 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:28:03 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue"/>
Apr 12 02:28:03 user nova-compute[82184]:       <target dev="vdb" bus="virtio"/>
Apr 12 02:28:03 user nova-compute[82184]:       <boot order="1"/>
Apr 12 02:28:03 user nova-compute[82184]:     </disk>
Apr 12 02:28:03 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:28:03 user nova-compute[82184]:       <mac address="fa:16:3e:68:8c:bf"/>
Apr 12 02:28:03 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:28:03 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:28:03 user nova-compute[82184]:       <target dev="tap10e7ad4b-20"/>
Apr 12 02:28:03 user nova-compute[82184]:     </interface>
Apr 12 02:28:03 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:28:03 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/console.log" append="off"/>
Apr 12 02:28:03 user nova-compute[82184]:     </serial>
Apr 12 02:28:03 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:28:03 user nova-compute[82184]:     <video>
Apr 12 02:28:03 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:28:03 user nova-compute[82184]:     </video>
Apr 12 02:28:03 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:28:03 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:28:03 user nova-compute[82184]:     </rng>
Apr 12 02:28:03 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:28:03 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:28:03 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:28:03 user nova-compute[82184]:     </memballoon>
Apr 12 02:28:03 user nova-compute[82184]:   </devices>
Apr 12 02:28:03 user nova-compute[82184]: </domain>
Apr 12 02:28:03 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:28:03 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Instance destroyed successfully.
Apr 12 02:28:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:28:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:28:04 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] No VIF found with MAC fa:16:3e:68:8c:bf, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:28:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-8f360d83-5016-4900-8598-845930bee0ea req-d1755c81-6d64-4d14-b9e1-b0b611297f29 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:28:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8f360d83-5016-4900-8598-845930bee0ea req-d1755c81-6d64-4d14-b9e1-b0b611297f29 service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8f360d83-5016-4900-8598-845930bee0ea req-d1755c81-6d64-4d14-b9e1-b0b611297f29 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:05 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8f360d83-5016-4900-8598-845930bee0ea req-d1755c81-6d64-4d14-b9e1-b0b611297f29 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:05 user nova-compute[82184]: DEBUG nova.compute.manager [req-8f360d83-5016-4900-8598-845930bee0ea req-d1755c81-6d64-4d14-b9e1-b0b611297f29 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:28:05 user nova-compute[82184]: WARNING nova.compute.manager [req-8f360d83-5016-4900-8598-845930bee0ea req-d1755c81-6d64-4d14-b9e1-b0b611297f29 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state active and task_state rescuing.
Apr 12 02:28:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:06 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for e9b52057-9ce7-42c0-ae32-1c01cf92ce39 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266487.410002, e9b52057-9ce7-42c0-ae32-1c01cf92ce39 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:28:07 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] VM Resumed (Lifecycle Event)
Apr 12 02:28:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-df90a9f5-af84-496a-bd83-fe1795c3a1c6 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:28:07 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 02:28:07 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266487.4117594, e9b52057-9ce7-42c0-ae32-1c01cf92ce39 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:28:07 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] VM Started (Lifecycle Event)
Apr 12 02:28:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-c84f6dba-4d99-42ad-9cd5-f9da6dd7c239 req-f9f8960f-82e6-4794-aa22-3a4538d120ce service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c84f6dba-4d99-42ad-9cd5-f9da6dd7c239 req-f9f8960f-82e6-4794-aa22-3a4538d120ce service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c84f6dba-4d99-42ad-9cd5-f9da6dd7c239 req-f9f8960f-82e6-4794-aa22-3a4538d120ce service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c84f6dba-4d99-42ad-9cd5-f9da6dd7c239 req-f9f8960f-82e6-4794-aa22-3a4538d120ce service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:07 user nova-compute[82184]: DEBUG nova.compute.manager [req-c84f6dba-4d99-42ad-9cd5-f9da6dd7c239 req-f9f8960f-82e6-4794-aa22-3a4538d120ce service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:28:07 user nova-compute[82184]: WARNING nova.compute.manager [req-c84f6dba-4d99-42ad-9cd5-f9da6dd7c239 req-f9f8960f-82e6-4794-aa22-3a4538d120ce service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state rescued and task_state None.
Apr 12 02:28:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:28:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:28:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:13 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:28:13 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:28:13 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:28:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:28:15 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:28:15 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:28:15 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=26.153732299804688GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e9b52057-9ce7-42c0-ae32-1c01cf92ce39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:28:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:28:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:28:17 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:28:17 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:28:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:28:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:28:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:28:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:28:17 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:28:17 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 3036c0b5-7987-4ff5-9edf-ee7397cf7beb {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:28:18 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updating instance_info_cache with network_info: [{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:28:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:28:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:28:18 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:28:18 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:28:19 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:28:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:28:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:28:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:28:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:28:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:25 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:28:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:28:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:28:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:28:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:28:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:28:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:28:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:28:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:28:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:28:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:29:08 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:29:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:29:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:29:14 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:29:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:29:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:29:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:29:14 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:29:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:29:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:29:15 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:16 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:29:16 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:29:16 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8658MB free_disk=26.153045654296875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e9b52057-9ce7-42c0-ae32-1c01cf92ce39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:29:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:29:19 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:29:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:29:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:29:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:29:19 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:29:20 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updating instance_info_cache with network_info: [{"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:29:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-811c4fb7-d984-461e-9190-4d0e9ec345c2" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:29:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:29:20 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:29:20 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:29:20 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:29:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:27 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:29:27 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:29:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:29:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:29:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:29:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:29:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:29:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:29:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:50 user nova-compute[82184]: INFO nova.compute.manager [None req-88688fef-091c-4ec3-ac13-3fdd85cc9138 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Unrescuing
Apr 12 02:29:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-88688fef-091c-4ec3-ac13-3fdd85cc9138 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:29:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-88688fef-091c-4ec3-ac13-3fdd85cc9138 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquired lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:29:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-88688fef-091c-4ec3-ac13-3fdd85cc9138 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG nova.network.neutron [None req-88688fef-091c-4ec3-ac13-3fdd85cc9138 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Updating instance_info_cache with network_info: [{"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-88688fef-091c-4ec3-ac13-3fdd85cc9138 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Releasing lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG nova.objects.instance [None req-88688fef-091c-4ec3-ac13-3fdd85cc9138 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'flavor' on Instance uuid e9b52057-9ce7-42c0-ae32-1c01cf92ce39 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-0ab06071-277b-4422-92d0-01d705ba43c5 req-99fcc231-e4b5-4db6-8460-ca37718cf52f service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0ab06071-277b-4422-92d0-01d705ba43c5 req-99fcc231-e4b5-4db6-8460-ca37718cf52f service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0ab06071-277b-4422-92d0-01d705ba43c5 req-99fcc231-e4b5-4db6-8460-ca37718cf52f service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0ab06071-277b-4422-92d0-01d705ba43c5 req-99fcc231-e4b5-4db6-8460-ca37718cf52f service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:29:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-0ab06071-277b-4422-92d0-01d705ba43c5 req-99fcc231-e4b5-4db6-8460-ca37718cf52f service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:29:51 user nova-compute[82184]: WARNING nova.compute.manager [req-0ab06071-277b-4422-92d0-01d705ba43c5 req-99fcc231-e4b5-4db6-8460-ca37718cf52f service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state rescued and task_state unrescuing.
Apr 12 02:29:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:52 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Instance destroyed successfully.
Apr 12 02:29:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:29:53 user nova-compute[82184]: WARNING nova.compute.manager [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state rescued and task_state unrescuing.
Apr 12 02:29:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:29:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:29:53 user nova-compute[82184]: WARNING nova.compute.manager [req-ad306677-ead1-4385-8468-4b282fd874af req-abfe795e-aed4-4b47-810d-8185348fd7d8 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state rescued and task_state unrescuing.
Apr 12 02:29:55 user nova-compute[82184]: DEBUG nova.virt.libvirt.host [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Removed pending event for e9b52057-9ce7-42c0-ae32-1c01cf92ce39 due to event {{(pid=82184) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 02:29:55 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266595.476002, e9b52057-9ce7-42c0-ae32-1c01cf92ce39 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:29:55 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] VM Resumed (Lifecycle Event)
Apr 12 02:29:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-88688fef-091c-4ec3-ac13-3fdd85cc9138 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:29:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:29:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:29:55 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 02:29:55 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266595.4774141, e9b52057-9ce7-42c0-ae32-1c01cf92ce39 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:29:55 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] VM Started (Lifecycle Event)
Apr 12 02:29:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:29:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:29:55 user nova-compute[82184]: DEBUG nova.compute.manager [req-32bd896c-e43f-41b3-96a5-da38bf8e07bf req-f224f23b-1b17-417d-a146-ad765a8b1bb8 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:29:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-32bd896c-e43f-41b3-96a5-da38bf8e07bf req-f224f23b-1b17-417d-a146-ad765a8b1bb8 service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:29:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-32bd896c-e43f-41b3-96a5-da38bf8e07bf req-f224f23b-1b17-417d-a146-ad765a8b1bb8 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:29:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-32bd896c-e43f-41b3-96a5-da38bf8e07bf req-f224f23b-1b17-417d-a146-ad765a8b1bb8 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:29:55 user nova-compute[82184]: DEBUG nova.compute.manager [req-32bd896c-e43f-41b3-96a5-da38bf8e07bf req-f224f23b-1b17-417d-a146-ad765a8b1bb8 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:29:55 user nova-compute[82184]: WARNING nova.compute.manager [req-32bd896c-e43f-41b3-96a5-da38bf8e07bf req-f224f23b-1b17-417d-a146-ad765a8b1bb8 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state active and task_state None.
Apr 12 02:29:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:29:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:30:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:30:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:30:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:30:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:10 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:30:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:30:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:16 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:30:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:30:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:30:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:30:16 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:30:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:30:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:30:17 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:30:17 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:30:17 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8609MB free_disk=26.136367797851562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:30:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:30:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:30:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:30:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:30:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e9b52057-9ce7-42c0-ae32-1c01cf92ce39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:30:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:30:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:30:18 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:30:18 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:30:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:30:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Updating instance_info_cache with network_info: [{"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-35de4fd0-e7b2-484c-b261-fca54a8103a8" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:30:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:30:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:25 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:30:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:27 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:30:27 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:30:29 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:30:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:30:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:30:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:30:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:30:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:30:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:30:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:30:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:30:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:30:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:30:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:30:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:31:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:31:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:11 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:31:16 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:17 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:31:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:17 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:17 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:31:17 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:31:17 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8653MB free_disk=26.135757446289062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:31:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:31:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:31:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:31:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:31:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:31:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance e9b52057-9ce7-42c0-ae32-1c01cf92ce39 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:31:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:31:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:31:18 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:31:18 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:31:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:31:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Updating instance_info_cache with network_info: [{"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-e9b52057-9ce7-42c0-ae32-1c01cf92ce39" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:22 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:22 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:31:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:31:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:28 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:31:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:31:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:31 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:31:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:31:41 user nova-compute[82184]: INFO nova.compute.manager [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Terminating instance
Apr 12 02:31:41 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-7e59ab5e-3cc2-47fa-b567-0907f797f522 req-6f679cf1-1b8c-4fb5-b767-e78e4e5de866 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7e59ab5e-3cc2-47fa-b567-0907f797f522 req-6f679cf1-1b8c-4fb5-b767-e78e4e5de866 service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7e59ab5e-3cc2-47fa-b567-0907f797f522 req-6f679cf1-1b8c-4fb5-b767-e78e4e5de866 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7e59ab5e-3cc2-47fa-b567-0907f797f522 req-6f679cf1-1b8c-4fb5-b767-e78e4e5de866 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-7e59ab5e-3cc2-47fa-b567-0907f797f522 req-6f679cf1-1b8c-4fb5-b767-e78e4e5de866 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-7e59ab5e-3cc2-47fa-b567-0907f797f522 req-6f679cf1-1b8c-4fb5-b767-e78e4e5de866 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-unplugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:42 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Instance destroyed successfully.
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.objects.instance [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'resources' on Instance uuid e9b52057-9ce7-42c0-ae32-1c01cf92ce39 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:26:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1066136151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1066136151',id=43,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:28:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-zfudcdgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:29:56Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=e9b52057-9ce7-42c0-ae32-1c01cf92ce39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "address": "fa:16:3e:68:8c:bf", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e7ad4b-20", "ovs_interfaceid": "10e7ad4b-208f-4fee-bdd3-2f9c98e34853", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:8c:bf,bridge_name='br-int',has_traffic_filtering=True,id=10e7ad4b-208f-4fee-bdd3-2f9c98e34853,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e7ad4b-20') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_vif [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:8c:bf,bridge_name='br-int',has_traffic_filtering=True,id=10e7ad4b-208f-4fee-bdd3-2f9c98e34853,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e7ad4b-20') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10e7ad4b-20, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:31:42 user nova-compute[82184]: INFO os_vif [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:8c:bf,bridge_name='br-int',has_traffic_filtering=True,id=10e7ad4b-208f-4fee-bdd3-2f9c98e34853,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e7ad4b-20')
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AaKSbLnr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:31:42 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9a268f-2690-4874-ac71-baef7dd81111]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:31:42 user nova-compute[82184]: No targets found.
Apr 12 02:31:42 user nova-compute[82184]: iSNS:
Apr 12 02:31:42 user nova-compute[82184]: No targets found.
Apr 12 02:31:42 user nova-compute[82184]: STATIC:
Apr 12 02:31:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34
Apr 12 02:31:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:31:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:31:42 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04
Apr 12 02:31:42 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:31:42 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:31:42 user nova-compute[82184]: FIRMWARE:
Apr 12 02:31:42 user nova-compute[82184]: No targets found.
Apr 12 02:31:42 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:31:42 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:31:42 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[805237a4-1cdc-438e-b1b0-ee2eed069602]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9ca7b0-d26e-4357-98e7-ee0a2fa50249]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:31:42 user nova-compute[82184]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 (non-flash)
Apr 12 02:31:42 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:31:42 user nova-compute[82184]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 (non-flash)
Apr 12 02:31:42 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a8213490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c98db-5169-4bcd-9edc-7962e0d28429]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0578fae1-ea72-4ad3-aee4-3e340d7ee16a]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad560087-6edb-444f-ae99-9592b10fa383]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.092s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7371691-b9dd-4d0a-86cd-7ac6044a66a0]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c31c236-bcb1-430d-90bf-73b16e160d79]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab33db1c-be5c-4683-832f-ac8366a6bfaa]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04, portal: 172.16.0.220,3260]
Apr 12 02:31:42 user nova-compute[82184]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04, portal: 172.16.0.220,3260] successful.
Apr 12 02:31:42 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53de24a4-e555-4257-b102-ea6d2d173d04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acf7ba4-ab71-4d08-a5f9-2966af0c3678]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] <== disconnect_volume: return (354ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:31:42 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Deleting instance files /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39_del
Apr 12 02:31:42 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Deletion of /opt/stack/data/nova/instances/e9b52057-9ce7-42c0-ae32-1c01cf92ce39_del complete
Apr 12 02:31:42 user nova-compute[82184]: INFO nova.compute.manager [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 12 02:31:42 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:31:42 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:31:43 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:31:43 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Took 0.45 seconds to deallocate network for instance.
Apr 12 02:31:43 user nova-compute[82184]: DEBUG nova.compute.manager [req-a020e25c-4bb6-49f0-b8d2-1b795917289f req-3f475eba-ab5e-4611-8675-d5e15a2d1b49 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-deleted-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:31:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-fda8e530-c366-4452-b713-b66539549ee1 req-5e346d5c-f5f4-45a9-9aa4-c8d3d3a4c3b2 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:31:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fda8e530-c366-4452-b713-b66539549ee1 req-5e346d5c-f5f4-45a9-9aa4-c8d3d3a4c3b2 service nova] Acquiring lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:31:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fda8e530-c366-4452-b713-b66539549ee1 req-5e346d5c-f5f4-45a9-9aa4-c8d3d3a4c3b2 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:31:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fda8e530-c366-4452-b713-b66539549ee1 req-5e346d5c-f5f4-45a9-9aa4-c8d3d3a4c3b2 service nova] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:31:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-fda8e530-c366-4452-b713-b66539549ee1 req-5e346d5c-f5f4-45a9-9aa4-c8d3d3a4c3b2 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] No waiting events found dispatching network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:31:44 user nova-compute[82184]: WARNING nova.compute.manager [req-fda8e530-c366-4452-b713-b66539549ee1 req-5e346d5c-f5f4-45a9-9aa4-c8d3d3a4c3b2 service nova] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Received unexpected event network-vif-plugged-10e7ad4b-208f-4fee-bdd3-2f9c98e34853 for instance with vm_state active and task_state deleting.
Apr 12 02:31:44 user nova-compute[82184]: INFO nova.compute.manager [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Took 0.83 seconds to detach 1 volumes for instance.
Apr 12 02:31:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:31:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:31:44 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:31:44 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:31:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:31:44 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Deleted allocations for instance e9b52057-9ce7-42c0-ae32-1c01cf92ce39
Apr 12 02:31:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-c0ba466e-7ec0-452d-be7a-6b06e39b7a5b tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "e9b52057-9ce7-42c0-ae32-1c01cf92ce39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.817s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:31:44 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:45 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:31:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:31:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:31:57 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681266702.411642, e9b52057-9ce7-42c0-ae32-1c01cf92ce39 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:31:57 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] VM Stopped (Lifecycle Event)
Apr 12 02:31:57 user nova-compute[82184]: DEBUG nova.compute.manager [None req-c5f060f6-8795-4900-a0ca-2bb435f9f972 None None] [instance: e9b52057-9ce7-42c0-ae32-1c01cf92ce39] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:31:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:32:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:32:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:32:13 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:32:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:18 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:32:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:32:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:32:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:32:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:32:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:32:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:32:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:32:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:32:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:32:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:32:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:32:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:32:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:32:19 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:32:19 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:32:19 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8703MB free_disk=26.134902954101562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:32:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:32:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:32:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:32:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:32:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:22 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:32:22 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:32:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:32:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:32:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:32:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:32:22 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:32:22 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 3036c0b5-7987-4ff5-9edf-ee7397cf7beb {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:32:23 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updating instance_info_cache with network_info: [{"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:32:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-3036c0b5-7987-4ff5-9edf-ee7397cf7beb" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:32:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:32:23 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:32:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:32:27 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:32:28 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:32:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "35de4fd0-e7b2-484c-b261-fca54a8103a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:32:32 user nova-compute[82184]: INFO nova.compute.manager [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Terminating instance
Apr 12 02:32:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-44d7d723-1aab-4098-a939-91ac7d8692f1 req-258a6f87-b168-4080-937b-e05d9a696a98 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Received event network-vif-unplugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-44d7d723-1aab-4098-a939-91ac7d8692f1 req-258a6f87-b168-4080-937b-e05d9a696a98 service nova] Acquiring lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-44d7d723-1aab-4098-a939-91ac7d8692f1 req-258a6f87-b168-4080-937b-e05d9a696a98 service nova] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-44d7d723-1aab-4098-a939-91ac7d8692f1 req-258a6f87-b168-4080-937b-e05d9a696a98 service nova] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-44d7d723-1aab-4098-a939-91ac7d8692f1 req-258a6f87-b168-4080-937b-e05d9a696a98 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] No waiting events found dispatching network-vif-unplugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:32:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-44d7d723-1aab-4098-a939-91ac7d8692f1 req-258a6f87-b168-4080-937b-e05d9a696a98 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Received event network-vif-unplugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:32:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Instance destroyed successfully.
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'resources' on Instance uuid 35de4fd0-e7b2-484c-b261-fca54a8103a8 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1841847417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1841847417',id=42,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:23:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-s7tbbdlo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:25:07Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=35de4fd0-e7b2-484c-b261-fca54a8103a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "address": "fa:16:3e:d6:b0:16", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30f13766-70", "ovs_interfaceid": "30f13766-7037-4c15-82c7-4c1a2eb1f889", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b0:16,bridge_name='br-int',has_traffic_filtering=True,id=30f13766-7037-4c15-82c7-4c1a2eb1f889,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30f13766-70') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG os_vif [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b0:16,bridge_name='br-int',has_traffic_filtering=True,id=30f13766-7037-4c15-82c7-4c1a2eb1f889,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30f13766-70') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30f13766-70, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:32:33 user nova-compute[82184]: INFO os_vif [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:b0:16,bridge_name='br-int',has_traffic_filtering=True,id=30f13766-7037-4c15-82c7-4c1a2eb1f889,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30f13766-70')
Apr 12 02:32:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Deleting instance files /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8_del
Apr 12 02:32:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Deletion of /opt/stack/data/nova/instances/35de4fd0-e7b2-484c-b261-fca54a8103a8_del complete
Apr 12 02:32:33 user nova-compute[82184]: INFO nova.compute.manager [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 12 02:32:33 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:32:33 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Took 0.46 seconds to deallocate network for instance.
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-367f256a-da3d-4959-af4e-b6ed60747dea req-88cfddc2-6b1f-4f74-b9ef-5b9bae1f2f11 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Received event network-vif-deleted-30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:32:33 user nova-compute[82184]: INFO nova.compute.manager [req-367f256a-da3d-4959-af4e-b6ed60747dea req-88cfddc2-6b1f-4f74-b9ef-5b9bae1f2f11 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Neutron deleted interface 30f13766-7037-4c15-82c7-4c1a2eb1f889; detaching it from the instance and deleting it from the info cache
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.network.neutron [req-367f256a-da3d-4959-af4e-b6ed60747dea req-88cfddc2-6b1f-4f74-b9ef-5b9bae1f2f11 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.compute.manager [req-367f256a-da3d-4959-af4e-b6ed60747dea req-88cfddc2-6b1f-4f74-b9ef-5b9bae1f2f11 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Detach interface failed, port_id=30f13766-7037-4c15-82c7-4c1a2eb1f889, reason: Instance 35de4fd0-e7b2-484c-b261-fca54a8103a8 could not be found. {{(pid=82184) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:32:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:32:33 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Deleted allocations for instance 35de4fd0-e7b2-484c-b261-fca54a8103a8
Apr 12 02:32:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-29bcce96-3470-42ad-87c3-fa30c301ac3e tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.530s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:32:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-f33f20a5-e545-4ddd-9fca-3fa0fc21dc7d req-24abe6c2-2359-4cf1-a920-f8f6dcb596d1 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Received event network-vif-plugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:32:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f33f20a5-e545-4ddd-9fca-3fa0fc21dc7d req-24abe6c2-2359-4cf1-a920-f8f6dcb596d1 service nova] Acquiring lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:32:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f33f20a5-e545-4ddd-9fca-3fa0fc21dc7d req-24abe6c2-2359-4cf1-a920-f8f6dcb596d1 service nova] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:32:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f33f20a5-e545-4ddd-9fca-3fa0fc21dc7d req-24abe6c2-2359-4cf1-a920-f8f6dcb596d1 service nova] Lock "35de4fd0-e7b2-484c-b261-fca54a8103a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:32:35 user nova-compute[82184]: DEBUG nova.compute.manager [req-f33f20a5-e545-4ddd-9fca-3fa0fc21dc7d req-24abe6c2-2359-4cf1-a920-f8f6dcb596d1 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] No waiting events found dispatching network-vif-plugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:32:35 user nova-compute[82184]: WARNING nova.compute.manager [req-f33f20a5-e545-4ddd-9fca-3fa0fc21dc7d req-24abe6c2-2359-4cf1-a920-f8f6dcb596d1 service nova] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Received unexpected event network-vif-plugged-30f13766-7037-4c15-82c7-4c1a2eb1f889 for instance with vm_state deleted and task_state None.
Apr 12 02:32:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:32:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:32:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:32:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:32:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:48 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681266753.031865, 35de4fd0-e7b2-484c-b261-fca54a8103a8 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:32:48 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] VM Stopped (Lifecycle Event)
Apr 12 02:32:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e12a06d6-3895-4fb5-81bf-e1a7a41314d6 None None] [instance: 35de4fd0-e7b2-484c-b261-fca54a8103a8] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:32:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:32:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:32:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:33:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:14 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:33:15 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:33:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:33:18 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:33:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:33:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:33:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:33:18 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:33:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:33:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:19 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:33:19 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:33:19 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=26.225765228271484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 811c4fb7-d984-461e-9190-4d0e9ec345c2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:33:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:33:20 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:33:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:33:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:33:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:33:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:33:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:33:22 user nova-compute[82184]: INFO nova.compute.manager [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Terminating instance
Apr 12 02:33:22 user nova-compute[82184]: DEBUG nova.compute.manager [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-e070d9fe-17ad-4d66-9100-bac3b2c4ee4e req-66540cc8-d26a-401b-be71-d9f59562e0e6 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-unplugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e070d9fe-17ad-4d66-9100-bac3b2c4ee4e req-66540cc8-d26a-401b-be71-d9f59562e0e6 service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e070d9fe-17ad-4d66-9100-bac3b2c4ee4e req-66540cc8-d26a-401b-be71-d9f59562e0e6 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e070d9fe-17ad-4d66-9100-bac3b2c4ee4e req-66540cc8-d26a-401b-be71-d9f59562e0e6 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-e070d9fe-17ad-4d66-9100-bac3b2c4ee4e req-66540cc8-d26a-401b-be71-d9f59562e0e6 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-unplugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-e070d9fe-17ad-4d66-9100-bac3b2c4ee4e req-66540cc8-d26a-401b-be71-d9f59562e0e6 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-unplugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:23 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Instance destroyed successfully.
Apr 12 02:33:23 user nova-compute[82184]: DEBUG nova.objects.instance [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'resources' on Instance uuid 811c4fb7-d984-461e-9190-4d0e9ec345c2 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:17:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839044150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839044150',id=39,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-a1daltq0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:21:24Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=811c4fb7-d984-461e-9190-4d0e9ec345c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "address": "fa:16:3e:47:c2:75", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap217714fd-b1", "ovs_interfaceid": "217714fd-b1ef-4cf0-8f00-ec948d907b1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=217714fd-b1ef-4cf0-8f00-ec948d907b1b,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217714fd-b1') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_vif [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=217714fd-b1ef-4cf0-8f00-ec948d907b1b,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217714fd-b1') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap217714fd-b1, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:33:23 user nova-compute[82184]: INFO os_vif [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:c2:75,bridge_name='br-int',has_traffic_filtering=True,id=217714fd-b1ef-4cf0-8f00-ec948d907b1b,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap217714fd-b1')
Apr 12 02:33:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDcoqanN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:33:23 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6332b7f-80c0-4d51-8c6f-56577e1bbaed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:33:23 user nova-compute[82184]: No targets found.
Apr 12 02:33:23 user nova-compute[82184]: iSNS:
Apr 12 02:33:23 user nova-compute[82184]: No targets found.
Apr 12 02:33:23 user nova-compute[82184]: STATIC:
Apr 12 02:33:23 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34
Apr 12 02:33:23 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:33:23 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:33:23 user nova-compute[82184]: FIRMWARE:
Apr 12 02:33:23 user nova-compute[82184]: No targets found.
Apr 12 02:33:23 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:33:23 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:33:23 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a1723f-e0cd-4fbf-8e46-5858cf4222ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccd5072-f1b5-466d-926c-92b84eec6bf9]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:33:23 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 (non-flash)
Apr 12 02:33:23 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a8210820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34'): ({'sdd'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Removing single pathed devices sdd {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:33:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[78adecf6-b3f3-4193-8e3e-8d2ac9ea8ca9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98573a58-dcb8-4bc4-8276-4f719760dd30]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Flushing IO for device /dev/sdd {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0450b8ea-015e-452a-bc9b-a305d76051da]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a1a7af-e0ad-4e3b-b591-195c2cf92959]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] SCSI volumes sdd have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90153fb-7a42-4728-ac35-29409fd5810b]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f0e74b-99fb-4a91-919f-8a6d3f1b087c]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34, portal: 172.16.0.220,3260]
Apr 12 02:33:24 user nova-compute[82184]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34, portal: 172.16.0.220,3260] successful.
Apr 12 02:33:24 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:774cf9c9-daf1-4a88-8b14-008fd044bf34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[81df0379-13f8-4ddb-86fc-455e716ba4d3]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] <== disconnect_volume: return (308ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:33:24 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Deleting instance files /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2_del
Apr 12 02:33:24 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Deletion of /opt/stack/data/nova/instances/811c4fb7-d984-461e-9190-4d0e9ec345c2_del complete
Apr 12 02:33:24 user nova-compute[82184]: INFO nova.compute.manager [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Took 1.28 seconds to destroy the instance on the hypervisor.
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Skipping network cache update for instance because it is being deleted. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:24 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:33:24 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Took 0.64 seconds to deallocate network for instance.
Apr 12 02:33:24 user nova-compute[82184]: DEBUG nova.compute.manager [req-4182e4b5-2ca4-47ad-be48-e2840f55b843 req-30790bc1-b4d1-42f6-a566-ee6574e37120 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-deleted-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:33:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-f749c606-086c-4eef-897f-7eceb2aee74a req-dc37b478-1530-44ba-bd21-4bd6dec9eca8 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:33:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f749c606-086c-4eef-897f-7eceb2aee74a req-dc37b478-1530-44ba-bd21-4bd6dec9eca8 service nova] Acquiring lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:33:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f749c606-086c-4eef-897f-7eceb2aee74a req-dc37b478-1530-44ba-bd21-4bd6dec9eca8 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:33:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-f749c606-086c-4eef-897f-7eceb2aee74a req-dc37b478-1530-44ba-bd21-4bd6dec9eca8 service nova] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:33:25 user nova-compute[82184]: DEBUG nova.compute.manager [req-f749c606-086c-4eef-897f-7eceb2aee74a req-dc37b478-1530-44ba-bd21-4bd6dec9eca8 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] No waiting events found dispatching network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:33:25 user nova-compute[82184]: WARNING nova.compute.manager [req-f749c606-086c-4eef-897f-7eceb2aee74a req-dc37b478-1530-44ba-bd21-4bd6dec9eca8 service nova] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Received unexpected event network-vif-plugged-217714fd-b1ef-4cf0-8f00-ec948d907b1b for instance with vm_state active and task_state deleting.
Apr 12 02:33:25 user nova-compute[82184]: INFO nova.compute.manager [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Took 0.81 seconds to detach 1 volumes for instance.
Apr 12 02:33:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:33:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:33:25 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:33:25 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:33:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:33:25 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Deleted allocations for instance 811c4fb7-d984-461e-9190-4d0e9ec345c2
Apr 12 02:33:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-17393fbc-380d-4d61-8d82-857af0b94ccd tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "811c4fb7-d984-461e-9190-4d0e9ec345c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.061s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:33:28 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:33:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:33:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:32 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:33:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:33:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:33:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:33:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:33:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:38 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681266803.8050158, 811c4fb7-d984-461e-9190-4d0e9ec345c2 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:33:38 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] VM Stopped (Lifecycle Event)
Apr 12 02:33:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6093a130-5a0d-40aa-8fb9-55968222af16 None None] [instance: 811c4fb7-d984-461e-9190-4d0e9ec345c2] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:33:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:33:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:33:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:33:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:33:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:33:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:33:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:34:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:34:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:34:13 user nova-compute[82184]: INFO nova.compute.manager [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Terminating instance
Apr 12 02:34:13 user nova-compute[82184]: DEBUG nova.compute.manager [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-39b40032-1f97-4d15-b656-759309c1ec27 req-51c7fb8a-f658-4bcb-90cb-d3585887d4e0 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received event network-vif-unplugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-39b40032-1f97-4d15-b656-759309c1ec27 req-51c7fb8a-f658-4bcb-90cb-d3585887d4e0 service nova] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-39b40032-1f97-4d15-b656-759309c1ec27 req-51c7fb8a-f658-4bcb-90cb-d3585887d4e0 service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-39b40032-1f97-4d15-b656-759309c1ec27 req-51c7fb8a-f658-4bcb-90cb-d3585887d4e0 service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-39b40032-1f97-4d15-b656-759309c1ec27 req-51c7fb8a-f658-4bcb-90cb-d3585887d4e0 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] No waiting events found dispatching network-vif-unplugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:34:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-39b40032-1f97-4d15-b656-759309c1ec27 req-51c7fb8a-f658-4bcb-90cb-d3585887d4e0 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received event network-vif-unplugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:14 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Instance destroyed successfully.
Apr 12 02:34:14 user nova-compute[82184]: DEBUG nova.objects.instance [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lazy-loading 'resources' on Instance uuid 3036c0b5-7987-4ff5-9edf-ee7397cf7beb {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:14:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1938777543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1938777543',id=37,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6bb951049b464316a04647ce9c52963a',ramdisk_id='',reservation_id='r-8gl97olv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:16:36Z,user_data=None,user_id='fe9217f4c1ff428086140b7fd07194eb',uuid=3036c0b5-7987-4ff5-9edf-ee7397cf7beb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converting VIF {"id": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "address": "fa:16:3e:6d:62:12", "network": {"id": "68f69bfd-e205-4f13-92e2-346de9c67dd4", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2061711497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6bb951049b464316a04647ce9c52963a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap162c49eb-7e", "ovs_interfaceid": "162c49eb-7ebe-4a3d-aac4-10060fde3edf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:62:12,bridge_name='br-int',has_traffic_filtering=True,id=162c49eb-7ebe-4a3d-aac4-10060fde3edf,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c49eb-7e') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG os_vif [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:62:12,bridge_name='br-int',has_traffic_filtering=True,id=162c49eb-7ebe-4a3d-aac4-10060fde3edf,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c49eb-7e') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap162c49eb-7e, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:34:14 user nova-compute[82184]: INFO os_vif [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:62:12,bridge_name='br-int',has_traffic_filtering=True,id=162c49eb-7ebe-4a3d-aac4-10060fde3edf,network=Network(68f69bfd-e205-4f13-92e2-346de9c67dd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap162c49eb-7e')
Apr 12 02:34:14 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Deleting instance files /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb_del
Apr 12 02:34:14 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Deletion of /opt/stack/data/nova/instances/3036c0b5-7987-4ff5-9edf-ee7397cf7beb_del complete
Apr 12 02:34:14 user nova-compute[82184]: INFO nova.compute.manager [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 02:34:14 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:34:14 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:34:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:15 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:34:15 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:34:15 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Took 1.25 seconds to deallocate network for instance.
Apr 12 02:34:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:34:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:34:15 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] No waiting events found dispatching network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:34:16 user nova-compute[82184]: WARNING nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received unexpected event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf for instance with vm_state deleted and task_state None.
Apr 12 02:34:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] No waiting events found dispatching network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:34:16 user nova-compute[82184]: WARNING nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received unexpected event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf for instance with vm_state deleted and task_state None.
Apr 12 02:34:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] No waiting events found dispatching network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:34:16 user nova-compute[82184]: WARNING nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received unexpected event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf for instance with vm_state deleted and task_state None.
Apr 12 02:34:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Acquiring lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] No waiting events found dispatching network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:34:16 user nova-compute[82184]: WARNING nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received unexpected event network-vif-plugged-162c49eb-7ebe-4a3d-aac4-10060fde3edf for instance with vm_state deleted and task_state None.
Apr 12 02:34:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-4a63506d-ec8f-46d5-80f2-bdc13d8e7086 req-1cb236b3-fb51-4b3c-90ed-5bce83e32e65 service nova] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Received event network-vif-deleted-162c49eb-7ebe-4a3d-aac4-10060fde3edf {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:34:16 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Deleted allocations for instance 3036c0b5-7987-4ff5-9edf-ee7397cf7beb
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-bc385d1a-eb93-44af-a52e-15674c5fac46 tempest-ServerBootFromVolumeStableRescueTest-1070279577 tempest-ServerBootFromVolumeStableRescueTest-1070279577-project-member] Lock "3036c0b5-7987-4ff5-9edf-ee7397cf7beb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.403s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:34:16 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:34:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:19 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:34:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:34:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:34:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:34:19 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:34:20 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:34:20 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:34:20 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8851MB free_disk=26.316356658935547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:34:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:34:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:34:20 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:34:20 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:34:20 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:34:20 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:34:20 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:34:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:34:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:34:23 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:34:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:34:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:34:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:34:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:34:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:34:29 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681266854.5101712, 3036c0b5-7987-4ff5-9edf-ee7397cf7beb => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:34:29 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] VM Stopped (Lifecycle Event)
Apr 12 02:34:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-3783612c-261c-49f5-a06b-8bdbb4c3c20a None None] [instance: 3036c0b5-7987-4ff5-9edf-ee7397cf7beb] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:34:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:34:29 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:34:29 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:34:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:34:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:34:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:34:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:34:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:34:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:34:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:34:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:34:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:34:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:34:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:34:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:34:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:35:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:17 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:35:17 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:35:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:35:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:35:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:35:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:35:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:35:17 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:35:17 user nova-compute[82184]: INFO nova.compute.claims [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Claim successful on node user
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:35:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.policy [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b14e24aaf4e94584a824ff4886e89db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2245b2b35848928e8e53439a1d9cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:35:18 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Creating image(s)
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "/opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "/opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "/opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk 1073741824" returned: 0 in 0.049s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Cannot resize image /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.objects.instance [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'migration_context' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Ensure instance console log exists: /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:35:18 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:35:19 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Successfully created port: 5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:35:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:19 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Successfully updated port: 5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:35:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:35:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:35:19 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:35:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-17f5ba63-21ce-40b6-b8d8-b753f428eff8 req-cb7f9fc9-53a4-4d9b-a6bd-59271e93f2a7 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-changed-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:35:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-17f5ba63-21ce-40b6-b8d8-b753f428eff8 req-cb7f9fc9-53a4-4d9b-a6bd-59271e93f2a7 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Refreshing instance network info cache due to event network-changed-5b85d915-02dc-4e6b-9b28-e873d9b61c7d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:35:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-17f5ba63-21ce-40b6-b8d8-b753f428eff8 req-cb7f9fc9-53a4-4d9b-a6bd-59271e93f2a7 service nova] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:35:19 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.network.neutron [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Instance network_info: |[{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-17f5ba63-21ce-40b6-b8d8-b753f428eff8 req-cb7f9fc9-53a4-4d9b-a6bd-59271e93f2a7 service nova] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.network.neutron [req-17f5ba63-21ce-40b6-b8d8-b753f428eff8 req-cb7f9fc9-53a4-4d9b-a6bd-59271e93f2a7 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Refreshing network info cache for port 5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Start _get_guest_xml network_info=[{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:35:20 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:35:20 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616847054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616847054',id=44,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtoSQHC4yFKsSO0sQxkGPQvZnabNgsGvZ+PAGIKtWK5Je1BVouvWpb7OzRABncPbZnXWYtel/GG2A5dh7y+j1UOv9Y0st7v2BuEsWOkf4zfAMZhgkbwTSXP2ko7gvb2cQ==',key_name='tempest-keypair-2136830748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-e9wdsozg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=322ac98d-d990-4841-b98c-74a53382efd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.objects.instance [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'pci_devices' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:35:20 user nova-compute[82184]:   <uuid>322ac98d-d990-4841-b98c-74a53382efd6</uuid>
Apr 12 02:35:20 user nova-compute[82184]:   <name>instance-0000002c</name>
Apr 12 02:35:20 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:35:20 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:35:20 user nova-compute[82184]:   <metadata>
Apr 12 02:35:20 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:35:20 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:35:20 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1616847054</nova:name>
Apr 12 02:35:20 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:35:20</nova:creationTime>
Apr 12 02:35:20 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:35:20 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:35:20 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:35:20 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:35:20 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:35:20 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:35:20 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:35:20 user nova-compute[82184]:       <nova:owner>
Apr 12 02:35:20 user nova-compute[82184]:         <nova:user uuid="b14e24aaf4e94584a824ff4886e89db6">tempest-AttachVolumeShelveTestJSON-817837534-project-member</nova:user>
Apr 12 02:35:20 user nova-compute[82184]:         <nova:project uuid="ef2245b2b35848928e8e53439a1d9cb6">tempest-AttachVolumeShelveTestJSON-817837534</nova:project>
Apr 12 02:35:20 user nova-compute[82184]:       </nova:owner>
Apr 12 02:35:20 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:35:20 user nova-compute[82184]:       <nova:ports>
Apr 12 02:35:20 user nova-compute[82184]:         <nova:port uuid="5b85d915-02dc-4e6b-9b28-e873d9b61c7d">
Apr 12 02:35:20 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 02:35:20 user nova-compute[82184]:         </nova:port>
Apr 12 02:35:20 user nova-compute[82184]:       </nova:ports>
Apr 12 02:35:20 user nova-compute[82184]:     </nova:instance>
Apr 12 02:35:20 user nova-compute[82184]:   </metadata>
Apr 12 02:35:20 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:35:20 user nova-compute[82184]:     <system>
Apr 12 02:35:20 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:35:20 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:35:20 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:35:20 user nova-compute[82184]:       <entry name="serial">322ac98d-d990-4841-b98c-74a53382efd6</entry>
Apr 12 02:35:20 user nova-compute[82184]:       <entry name="uuid">322ac98d-d990-4841-b98c-74a53382efd6</entry>
Apr 12 02:35:20 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:35:20 user nova-compute[82184]:     </system>
Apr 12 02:35:20 user nova-compute[82184]:   </sysinfo>
Apr 12 02:35:20 user nova-compute[82184]:   <os>
Apr 12 02:35:20 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:35:20 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:35:20 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:35:20 user nova-compute[82184]:   </os>
Apr 12 02:35:20 user nova-compute[82184]:   <features>
Apr 12 02:35:20 user nova-compute[82184]:     <acpi/>
Apr 12 02:35:20 user nova-compute[82184]:     <apic/>
Apr 12 02:35:20 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:35:20 user nova-compute[82184]:   </features>
Apr 12 02:35:20 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:35:20 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:35:20 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:35:20 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:35:20 user nova-compute[82184]:   </clock>
Apr 12 02:35:20 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:35:20 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:35:20 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:35:20 user nova-compute[82184]:   </cpu>
Apr 12 02:35:20 user nova-compute[82184]:   <devices>
Apr 12 02:35:20 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:35:20 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:35:20 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk"/>
Apr 12 02:35:20 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:35:20 user nova-compute[82184]:     </disk>
Apr 12 02:35:20 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:35:20 user nova-compute[82184]:       <mac address="fa:16:3e:13:b3:f0"/>
Apr 12 02:35:20 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:35:20 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:35:20 user nova-compute[82184]:       <target dev="tap5b85d915-02"/>
Apr 12 02:35:20 user nova-compute[82184]:     </interface>
Apr 12 02:35:20 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:35:20 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/console.log" append="off"/>
Apr 12 02:35:20 user nova-compute[82184]:     </serial>
Apr 12 02:35:20 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:35:20 user nova-compute[82184]:     <video>
Apr 12 02:35:20 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:35:20 user nova-compute[82184]:     </video>
Apr 12 02:35:20 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:35:20 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:35:20 user nova-compute[82184]:     </rng>
Apr 12 02:35:20 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:35:20 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:35:20 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:35:20 user nova-compute[82184]:     </memballoon>
Apr 12 02:35:20 user nova-compute[82184]:   </devices>
Apr 12 02:35:20 user nova-compute[82184]: </domain>
Apr 12 02:35:20 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616847054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616847054',id=44,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtoSQHC4yFKsSO0sQxkGPQvZnabNgsGvZ+PAGIKtWK5Je1BVouvWpb7OzRABncPbZnXWYtel/GG2A5dh7y+j1UOv9Y0st7v2BuEsWOkf4zfAMZhgkbwTSXP2ko7gvb2cQ==',key_name='tempest-keypair-2136830748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-e9wdsozg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=322ac98d-d990-4841-b98c-74a53382efd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG os_vif [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b85d915-02, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b85d915-02, col_values=(('external_ids', {'iface-id': '5b85d915-02dc-4e6b-9b28-e873d9b61c7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:b3:f0', 'vm-uuid': '322ac98d-d990-4841-b98c-74a53382efd6'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:20 user nova-compute[82184]: INFO os_vif [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02')
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] No VIF found with MAC fa:16:3e:13:b3:f0, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.network.neutron [req-17f5ba63-21ce-40b6-b8d8-b753f428eff8 req-cb7f9fc9-53a4-4d9b-a6bd-59271e93f2a7 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updated VIF entry in instance network info cache for port 5b85d915-02dc-4e6b-9b28-e873d9b61c7d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG nova.network.neutron [req-17f5ba63-21ce-40b6-b8d8-b753f428eff8 req-cb7f9fc9-53a4-4d9b-a6bd-59271e93f2a7 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-17f5ba63-21ce-40b6-b8d8-b753f428eff8 req-cb7f9fc9-53a4-4d9b-a6bd-59271e93f2a7 service nova] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:35:20 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-b0591b10-dfa3-4956-b9b4-af4b988cf6a2 req-12a9968c-2913-496c-86fe-186c6c9e4a46 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b0591b10-dfa3-4956-b9b4-af4b988cf6a2 req-12a9968c-2913-496c-86fe-186c6c9e4a46 service nova] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b0591b10-dfa3-4956-b9b4-af4b988cf6a2 req-12a9968c-2913-496c-86fe-186c6c9e4a46 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-b0591b10-dfa3-4956-b9b4-af4b988cf6a2 req-12a9968c-2913-496c-86fe-186c6c9e4a46 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG nova.compute.manager [req-b0591b10-dfa3-4956-b9b4-af4b988cf6a2 req-12a9968c-2913-496c-86fe-186c6c9e4a46 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] No waiting events found dispatching network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:35:21 user nova-compute[82184]: WARNING nova.compute.manager [req-b0591b10-dfa3-4956-b9b4-af4b988cf6a2 req-12a9968c-2913-496c-86fe-186c6c9e4a46 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received unexpected event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d for instance with vm_state building and task_state spawning.
Apr 12 02:35:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:35:21 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:22 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:35:22 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:35:22 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8878MB free_disk=26.306541442871094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 322ac98d-d990-4841-b98c-74a53382efd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:35:22 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266923.7860723, 322ac98d-d990-4841-b98c-74a53382efd6 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:35:23 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] VM Resumed (Lifecycle Event)
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:35:23 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Instance spawned successfully.
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:35:23 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681266923.7886, 322ac98d-d990-4841-b98c-74a53382efd6 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:35:23 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] VM Started (Lifecycle Event)
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-7ade8059-f0a2-449d-b076-b8a0f857d23f req-10bd8420-c122-43b2-b613-07f52903f8a2 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7ade8059-f0a2-449d-b076-b8a0f857d23f req-10bd8420-c122-43b2-b613-07f52903f8a2 service nova] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7ade8059-f0a2-449d-b076-b8a0f857d23f req-10bd8420-c122-43b2-b613-07f52903f8a2 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7ade8059-f0a2-449d-b076-b8a0f857d23f req-10bd8420-c122-43b2-b613-07f52903f8a2 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.compute.manager [req-7ade8059-f0a2-449d-b076-b8a0f857d23f req-10bd8420-c122-43b2-b613-07f52903f8a2 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] No waiting events found dispatching network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:35:23 user nova-compute[82184]: WARNING nova.compute.manager [req-7ade8059-f0a2-449d-b076-b8a0f857d23f req-10bd8420-c122-43b2-b613-07f52903f8a2 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received unexpected event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d for instance with vm_state building and task_state spawning.
Apr 12 02:35:23 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:35:23 user nova-compute[82184]: INFO nova.compute.manager [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Took 5.62 seconds to spawn the instance on the hypervisor.
Apr 12 02:35:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:35:24 user nova-compute[82184]: INFO nova.compute.manager [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Took 6.12 seconds to build instance.
Apr 12 02:35:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-cedfcceb-e8f1-48ab-82ac-d3071e6f2872 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.223s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:35:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:25 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:35:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:35:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:28 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:35:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:35:28 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:35:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:35:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:35:28 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:35:28 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:35:29 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:35:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:35:29 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:35:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:30 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:35:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:35:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:35:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:35:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:36:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:36:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:36:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:36:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:36:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:36:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:18 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:19 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:36:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:36:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:20 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:23 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:36:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:36:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:36:23 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:36:23 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:36:24 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:36:24 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:36:24 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=26.285831451416016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 322ac98d-d990-4841-b98c-74a53382efd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:36:24 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:36:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:25 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:30 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:36:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:36:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:36:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:36:30 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:36:30 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:36:31 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:36:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:36:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:36:31 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:36:31 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:36:31 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:36:32 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:36:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:36:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:38 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:36:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:36:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:36:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:36:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:36:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:36:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:36:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:36:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:36:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:37:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:37:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:37:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:37:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:37:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:03 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:37:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:37:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "322ac98d-d990-4841-b98c-74a53382efd6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:37:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "322ac98d-d990-4841-b98c-74a53382efd6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:37:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:37:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:37:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:37:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:37:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-0052c9c1-3aa5-429a-b0fc-c66193ef263b req-e0a494a9-1a8a-4645-899e-5787dc7a0205 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-changed-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:37:08 user nova-compute[82184]: DEBUG nova.compute.manager [req-0052c9c1-3aa5-429a-b0fc-c66193ef263b req-e0a494a9-1a8a-4645-899e-5787dc7a0205 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Refreshing instance network info cache due to event network-changed-5b85d915-02dc-4e6b-9b28-e873d9b61c7d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:37:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0052c9c1-3aa5-429a-b0fc-c66193ef263b req-e0a494a9-1a8a-4645-899e-5787dc7a0205 service nova] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:37:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0052c9c1-3aa5-429a-b0fc-c66193ef263b req-e0a494a9-1a8a-4645-899e-5787dc7a0205 service nova] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:37:08 user nova-compute[82184]: DEBUG nova.network.neutron [req-0052c9c1-3aa5-429a-b0fc-c66193ef263b req-e0a494a9-1a8a-4645-899e-5787dc7a0205 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Refreshing network info cache for port 5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:37:09 user nova-compute[82184]: DEBUG nova.network.neutron [req-0052c9c1-3aa5-429a-b0fc-c66193ef263b req-e0a494a9-1a8a-4645-899e-5787dc7a0205 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updated VIF entry in instance network info cache for port 5b85d915-02dc-4e6b-9b28-e873d9b61c7d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:37:09 user nova-compute[82184]: DEBUG nova.network.neutron [req-0052c9c1-3aa5-429a-b0fc-c66193ef263b req-e0a494a9-1a8a-4645-899e-5787dc7a0205 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:37:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-0052c9c1-3aa5-429a-b0fc-c66193ef263b req-e0a494a9-1a8a-4645-899e-5787dc7a0205 service nova] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:37:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:37:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:37:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:37:11 user nova-compute[82184]: INFO nova.compute.manager [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Shelving
Apr 12 02:37:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:11 user nova-compute[82184]: DEBUG nova.compute.manager [req-93f54781-de9f-4498-8819-2a371ac9473e req-58cd0d1a-a607-4baa-9f84-1fddd1c5ef3c service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-vif-unplugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:37:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-93f54781-de9f-4498-8819-2a371ac9473e req-58cd0d1a-a607-4baa-9f84-1fddd1c5ef3c service nova] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:37:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-93f54781-de9f-4498-8819-2a371ac9473e req-58cd0d1a-a607-4baa-9f84-1fddd1c5ef3c service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:37:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-93f54781-de9f-4498-8819-2a371ac9473e req-58cd0d1a-a607-4baa-9f84-1fddd1c5ef3c service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:37:11 user nova-compute[82184]: DEBUG nova.compute.manager [req-93f54781-de9f-4498-8819-2a371ac9473e req-58cd0d1a-a607-4baa-9f84-1fddd1c5ef3c service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] No waiting events found dispatching network-vif-unplugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:37:11 user nova-compute[82184]: WARNING nova.compute.manager [req-93f54781-de9f-4498-8819-2a371ac9473e req-58cd0d1a-a607-4baa-9f84-1fddd1c5ef3c service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received unexpected event network-vif-unplugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d for instance with vm_state active and task_state shelving.
Apr 12 02:37:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:11 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Instance destroyed successfully.
Apr 12 02:37:11 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Beginning cold snapshot process
Apr 12 02:37:12 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:37:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk /opt/stack/data/nova/instances/snapshots/tmp2fljb19c/4cf12a55dc9b48f1853168f8ee943d17 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:37:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk /opt/stack/data/nova/instances/snapshots/tmp2fljb19c/4cf12a55dc9b48f1853168f8ee943d17" returned: 0 in 0.521s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:37:12 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Snapshot extracted, beginning image upload
Apr 12 02:37:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-1631e469-0ffc-45ed-91e4-c384a33a7908 req-171538c2-3554-4bda-8c6f-4b0e78d35df9 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:37:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1631e469-0ffc-45ed-91e4-c384a33a7908 req-171538c2-3554-4bda-8c6f-4b0e78d35df9 service nova] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:37:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1631e469-0ffc-45ed-91e4-c384a33a7908 req-171538c2-3554-4bda-8c6f-4b0e78d35df9 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:37:13 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1631e469-0ffc-45ed-91e4-c384a33a7908 req-171538c2-3554-4bda-8c6f-4b0e78d35df9 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:37:13 user nova-compute[82184]: DEBUG nova.compute.manager [req-1631e469-0ffc-45ed-91e4-c384a33a7908 req-171538c2-3554-4bda-8c6f-4b0e78d35df9 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] No waiting events found dispatching network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:37:13 user nova-compute[82184]: WARNING nova.compute.manager [req-1631e469-0ffc-45ed-91e4-c384a33a7908 req-171538c2-3554-4bda-8c6f-4b0e78d35df9 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received unexpected event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 02:37:14 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Snapshot image upload complete
Apr 12 02:37:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:37:14 user nova-compute[82184]: INFO nova.compute.manager [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Shelve offloading
Apr 12 02:37:14 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Instance destroyed successfully.
Apr 12 02:37:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:37:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:37:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:37:14 user nova-compute[82184]: DEBUG nova.network.neutron [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:37:15 user nova-compute[82184]: DEBUG nova.network.neutron [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:37:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:37:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:16 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Instance destroyed successfully.
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'resources' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616847054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616847054',id=44,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtoSQHC4yFKsSO0sQxkGPQvZnabNgsGvZ+PAGIKtWK5Je1BVouvWpb7OzRABncPbZnXWYtel/GG2A5dh7y+j1UOv9Y0st7v2BuEsWOkf4zfAMZhgkbwTSXP2ko7gvb2cQ==',key_name='tempest-keypair-2136830748',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-e9wdsozg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member',shelved_at='2023-04-12T02:37:14.672532',shelved_host='user',shelved_image_id='c79b34ae-f38f-419a-9f80-523a1e9d59a3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:37:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=322ac98d-d990-4841-b98c-74a53382efd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG os_vif [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b85d915-02, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-156935fd-2292-404b-a7e8-a06378c7321b req-34976eab-7fb6-43a2-841c-c569dd9dfc17 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-changed-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.compute.manager [req-156935fd-2292-404b-a7e8-a06378c7321b req-34976eab-7fb6-43a2-841c-c569dd9dfc17 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Refreshing instance network info cache due to event network-changed-5b85d915-02dc-4e6b-9b28-e873d9b61c7d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-156935fd-2292-404b-a7e8-a06378c7321b req-34976eab-7fb6-43a2-841c-c569dd9dfc17 service nova] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-156935fd-2292-404b-a7e8-a06378c7321b req-34976eab-7fb6-43a2-841c-c569dd9dfc17 service nova] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.network.neutron [req-156935fd-2292-404b-a7e8-a06378c7321b req-34976eab-7fb6-43a2-841c-c569dd9dfc17 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Refreshing network info cache for port 5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:37:16 user nova-compute[82184]: INFO os_vif [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02')
Apr 12 02:37:16 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Deleting instance files /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6_del
Apr 12 02:37:16 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Deletion of /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6_del complete
Apr 12 02:37:16 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Deleted allocations for instance 322ac98d-d990-4841-b98c-74a53382efd6
Apr 12 02:37:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.objects.instance [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'numa_topology' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.096s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-e844875c-2c58-44b6-a201-79d22a31c4b4 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.240s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.network.neutron [req-156935fd-2292-404b-a7e8-a06378c7321b req-34976eab-7fb6-43a2-841c-c569dd9dfc17 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updated VIF entry in instance network info cache for port 5b85d915-02dc-4e6b-9b28-e873d9b61c7d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG nova.network.neutron [req-156935fd-2292-404b-a7e8-a06378c7321b req-34976eab-7fb6-43a2-841c-c569dd9dfc17 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5b85d915-02", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:37:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-156935fd-2292-404b-a7e8-a06378c7321b req-34976eab-7fb6-43a2-841c-c569dd9dfc17 service nova] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:37:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:19 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:24 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:25 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:37:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:37:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:37:25 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:26 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:37:26 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=26.268638610839844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681267031.876871, 322ac98d-d990-4841-b98c-74a53382efd6 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:37:26 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] VM Stopped (Lifecycle Event)
Apr 12 02:37:26 user nova-compute[82184]: DEBUG nova.compute.manager [None req-19b0dd09-4369-4d80-ade4-6f847aa47306 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:37:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:28 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:32 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:37:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:37:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:37:33 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:33 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:37:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:37:38 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:37:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:37:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:37:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:38:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:38:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:38:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:38:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:38:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:38:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:38:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:38:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:38:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:38:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:38:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:38:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:38:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:38:25 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:38:25 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:38:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:38:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:38:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:38:25 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:38:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:38:26 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:38:26 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:38:26 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8925MB free_disk=26.26805877685547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:38:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:38:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:38:26 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:38:26 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:38:26 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:38:26 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:38:26 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:38:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:38:30 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:38:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:38:33 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:38:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:38:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:38:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:38:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:38:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:38:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:38:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:38:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:38:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:38:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:38:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:38:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:38:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:38:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:38:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:38:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:38:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:39:03 user nova-compute[82184]: INFO nova.compute.manager [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Unshelving
Apr 12 02:39:03 user nova-compute[82184]: INFO nova.virt.block_device [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Booting with volume d7e20126-acbc-421c-9437-88099560832f at /dev/vdc
Apr 12 02:39:03 user nova-compute[82184]: DEBUG os_brick.utils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae2febe-4644-4b4d-b7a5-e0f70160c83b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c401fbc-2ee6-407f-a5c3-1368f08dd125]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eed500-2b6c-4997-a3c0-ec8deddcaaf4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8a632a-1a6f-4fc5-8915-81de602fe95e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:39:03 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:39:03 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[663132ca-f3a9-494a-95c8-15df5244eb36]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG os_brick.utils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:39:03 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating existing volume attachment record: 75cecbd8-0405-4c5b-85f0-94f7a0e5f6ba {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:39:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:39:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:39:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:39:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:39:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:39:08 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:39:08 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'pci_requests' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:39:08 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'numa_topology' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:39:09 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:39:09 user nova-compute[82184]: INFO nova.compute.claims [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Claim successful on node user
Apr 12 02:39:09 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:39:09 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:39:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:39:09 user nova-compute[82184]: INFO nova.network.neutron [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating port 5b85d915-02dc-4e6b-9b28-e873d9b61c7d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 02:39:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:39:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:39:09 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:39:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-462d983a-76fa-40c0-8197-bc86efc2b0c1 req-d1e94150-87f0-4cd6-888c-2846a53d3b7e service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-changed-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:39:09 user nova-compute[82184]: DEBUG nova.compute.manager [req-462d983a-76fa-40c0-8197-bc86efc2b0c1 req-d1e94150-87f0-4cd6-888c-2846a53d3b7e service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Refreshing instance network info cache due to event network-changed-5b85d915-02dc-4e6b-9b28-e873d9b61c7d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:39:09 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-462d983a-76fa-40c0-8197-bc86efc2b0c1 req-d1e94150-87f0-4cd6-888c-2846a53d3b7e service nova] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:39:10 user nova-compute[82184]: DEBUG nova.network.neutron [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:39:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:39:10 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:39:10 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Creating image(s)
Apr 12 02:39:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "/opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:39:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "/opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:39:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "/opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:39:10 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'trusted_certs' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:39:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-462d983a-76fa-40c0-8197-bc86efc2b0c1 req-d1e94150-87f0-4cd6-888c-2846a53d3b7e service nova] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:39:10 user nova-compute[82184]: DEBUG nova.network.neutron [req-462d983a-76fa-40c0-8197-bc86efc2b0c1 req-d1e94150-87f0-4cd6-888c-2846a53d3b7e service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Refreshing network info cache for port 5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:39:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "d1c12a82b84ab8f96d245681c8ac968f7e541d87" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:39:10 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "d1c12a82b84ab8f96d245681c8ac968f7e541d87" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87.part --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87.part --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG nova.virt.images [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] c79b34ae-f38f-419a-9f80-523a1e9d59a3 was qcow2, converting to raw {{(pid=82184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87.part /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87.converted {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-462d983a-76fa-40c0-8197-bc86efc2b0c1 req-d1e94150-87f0-4cd6-888c-2846a53d3b7e service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updated VIF entry in instance network info cache for port 5b85d915-02dc-4e6b-9b28-e873d9b61c7d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG nova.network.neutron [req-462d983a-76fa-40c0-8197-bc86efc2b0c1 req-d1e94150-87f0-4cd6-888c-2846a53d3b7e service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-462d983a-76fa-40c0-8197-bc86efc2b0c1 req-d1e94150-87f0-4cd6-888c-2846a53d3b7e service nova] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87.part /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87.converted" returned: 0 in 0.363s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87.converted --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "d1c12a82b84ab8f96d245681c8ac968f7e541d87" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.376s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87 --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "d1c12a82b84ab8f96d245681c8ac968f7e541d87" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "d1c12a82b84ab8f96d245681c8ac968f7e541d87" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:39:11 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87 --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87,backing_fmt=raw /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87,backing_fmt=raw /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk 1073741824" returned: 0 in 0.049s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:12 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "d1c12a82b84ab8f96d245681c8ac968f7e541d87" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:39:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1c12a82b84ab8f96d245681c8ac968f7e541d87 --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:12 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'migration_context' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:39:12 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Rebasing disk image.
Apr 12 02:39:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:12 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 -F raw /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 -F raw /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk" returned: 0 in 1.955s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Ensure instance console log exists: /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Start _get_guest_xml network_info=[{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='16060d859368937826c2b230a6385c8f',container_format='bare',created_at=2023-04-12T02:37:11Z,direct_url=<?>,disk_format='qcow2',id=c79b34ae-f38f-419a-9f80-523a1e9d59a3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1616847054-shelved',owner='ef2245b2b35848928e8e53439a1d9cb6',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T02:37:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'boot_index': None, 'guest_format': None, 'attachment_id': '75cecbd8-0405-4c5b-85f0-94f7a0e5f6ba', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqocCnis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '322ac98d-d990-4841-b98c-74a53382efd6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7e20126-acbc-421c-9437-88099560832f', 'serial': 'd7e20126-acbc-421c-9437-88099560832f'}, 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:39:14 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:39:14 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='16060d859368937826c2b230a6385c8f',container_format='bare',created_at=2023-04-12T02:37:11Z,direct_url=<?>,disk_format='qcow2',id=c79b34ae-f38f-419a-9f80-523a1e9d59a3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1616847054-shelved',owner='ef2245b2b35848928e8e53439a1d9cb6',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T02:37:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'vcpu_model' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqocCnis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:39:14 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:39:14 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:39:14 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce861947-5e96-451c-b549-54f3a098c02b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:39:14 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[047f221f-889a-455a-b873-e2fafaab1ee7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f] added
Apr 12 02:39:14 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c829a321-609a-4b58-aa2b-0d0a4f390f61]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ee4b20-6c38-426a-9580-f8fd54dce11c]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rqocCnis {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rqocCnis" returned: 0 in 0.028s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd4383b-3bae-4f5e-8424-f1fda7d05f8a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rqocCnis'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[186e3acc-f6ef-4229-884e-eb570d1b5370]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6c3cff-edac-4aa6-ae87-9da1b4450d17]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 02:39:14 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 02:39:14 user nova-compute[82184]:  {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:39:14 user nova-compute[82184]: WARNING os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 02:39:14 user nova-compute[82184]: 
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d802737-1144-46dc-9c2d-eaa24ba34671]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f, portal: 172.16.0.220,3260]
Apr 12 02:39:14 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f, portal: 172.16.0.220,3260] successful.
Apr 12 02:39:14 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfb2f3d-757b-4960-a676-c706edc9dde9]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[338cf39c-b8ef-4a91-b97d-a9f3055f7a4d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f (non-flash)
Apr 12 02:39:14 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f (non-flash)
Apr 12 02:39:14 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bef05f5-e071-4b9c-8438-8db2eed4051f]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:39:14 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqocCnis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:39:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:39:15 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23433396161383363', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:39:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433396161383363', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T02:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616847054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616847054',id=44,image_ref='c79b34ae-f38f-419a-9f80-523a1e9d59a3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2136830748',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-e9wdsozg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member',shelved_at='2023-04-12T02:37:14.672532',shelved_host='user',shelved_image_id='c79b34ae-f38f-419a-9f80-523a1e9d59a3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=322ac98d-d990-4841-b98c-74a53382efd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'pci_devices' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:39:16 user nova-compute[82184]:   <uuid>322ac98d-d990-4841-b98c-74a53382efd6</uuid>
Apr 12 02:39:16 user nova-compute[82184]:   <name>instance-0000002c</name>
Apr 12 02:39:16 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:39:16 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:39:16 user nova-compute[82184]:   <metadata>
Apr 12 02:39:16 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:39:16 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:39:16 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1616847054</nova:name>
Apr 12 02:39:16 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:39:14</nova:creationTime>
Apr 12 02:39:16 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:39:16 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:39:16 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:39:16 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:39:16 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:39:16 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:39:16 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:39:16 user nova-compute[82184]:       <nova:owner>
Apr 12 02:39:16 user nova-compute[82184]:         <nova:user uuid="b14e24aaf4e94584a824ff4886e89db6">tempest-AttachVolumeShelveTestJSON-817837534-project-member</nova:user>
Apr 12 02:39:16 user nova-compute[82184]:         <nova:project uuid="ef2245b2b35848928e8e53439a1d9cb6">tempest-AttachVolumeShelveTestJSON-817837534</nova:project>
Apr 12 02:39:16 user nova-compute[82184]:       </nova:owner>
Apr 12 02:39:16 user nova-compute[82184]:       <nova:root type="image" uuid="c79b34ae-f38f-419a-9f80-523a1e9d59a3"/>
Apr 12 02:39:16 user nova-compute[82184]:       <nova:ports>
Apr 12 02:39:16 user nova-compute[82184]:         <nova:port uuid="5b85d915-02dc-4e6b-9b28-e873d9b61c7d">
Apr 12 02:39:16 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 02:39:16 user nova-compute[82184]:         </nova:port>
Apr 12 02:39:16 user nova-compute[82184]:       </nova:ports>
Apr 12 02:39:16 user nova-compute[82184]:     </nova:instance>
Apr 12 02:39:16 user nova-compute[82184]:   </metadata>
Apr 12 02:39:16 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:39:16 user nova-compute[82184]:     <system>
Apr 12 02:39:16 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:39:16 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:39:16 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:39:16 user nova-compute[82184]:       <entry name="serial">322ac98d-d990-4841-b98c-74a53382efd6</entry>
Apr 12 02:39:16 user nova-compute[82184]:       <entry name="uuid">322ac98d-d990-4841-b98c-74a53382efd6</entry>
Apr 12 02:39:16 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:39:16 user nova-compute[82184]:     </system>
Apr 12 02:39:16 user nova-compute[82184]:   </sysinfo>
Apr 12 02:39:16 user nova-compute[82184]:   <os>
Apr 12 02:39:16 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:39:16 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:39:16 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:39:16 user nova-compute[82184]:   </os>
Apr 12 02:39:16 user nova-compute[82184]:   <features>
Apr 12 02:39:16 user nova-compute[82184]:     <acpi/>
Apr 12 02:39:16 user nova-compute[82184]:     <apic/>
Apr 12 02:39:16 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:39:16 user nova-compute[82184]:   </features>
Apr 12 02:39:16 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:39:16 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:39:16 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:39:16 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:39:16 user nova-compute[82184]:   </clock>
Apr 12 02:39:16 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:39:16 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:39:16 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:39:16 user nova-compute[82184]:   </cpu>
Apr 12 02:39:16 user nova-compute[82184]:   <devices>
Apr 12 02:39:16 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:39:16 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:39:16 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk"/>
Apr 12 02:39:16 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:39:16 user nova-compute[82184]:     </disk>
Apr 12 02:39:16 user nova-compute[82184]:     <disk type="block" device="disk">
Apr 12 02:39:16 user nova-compute[82184]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:39:16 user nova-compute[82184]:       <source dev="/dev/sdb"/>
Apr 12 02:39:16 user nova-compute[82184]:       <target dev="vdc" bus="virtio"/>
Apr 12 02:39:16 user nova-compute[82184]:       <serial>d7e20126-acbc-421c-9437-88099560832f</serial>
Apr 12 02:39:16 user nova-compute[82184]:     </disk>
Apr 12 02:39:16 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:39:16 user nova-compute[82184]:       <mac address="fa:16:3e:13:b3:f0"/>
Apr 12 02:39:16 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:39:16 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:39:16 user nova-compute[82184]:       <target dev="tap5b85d915-02"/>
Apr 12 02:39:16 user nova-compute[82184]:     </interface>
Apr 12 02:39:16 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:39:16 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/console.log" append="off"/>
Apr 12 02:39:16 user nova-compute[82184]:     </serial>
Apr 12 02:39:16 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:39:16 user nova-compute[82184]:     <video>
Apr 12 02:39:16 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:39:16 user nova-compute[82184]:     </video>
Apr 12 02:39:16 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:39:16 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:39:16 user nova-compute[82184]:     </rng>
Apr 12 02:39:16 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:39:16 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:39:16 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:39:16 user nova-compute[82184]:     </memballoon>
Apr 12 02:39:16 user nova-compute[82184]:   </devices>
Apr 12 02:39:16 user nova-compute[82184]: </domain>
Apr 12 02:39:16 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T02:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616847054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616847054',id=44,image_ref='c79b34ae-f38f-419a-9f80-523a1e9d59a3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2136830748',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:35:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-e9wdsozg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member',shelved_at='2023-04-12T02:37:14.672532',shelved_host='user',shelved_image_id='c79b34ae-f38f-419a-9f80-523a1e9d59a3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=322ac98d-d990-4841-b98c-74a53382efd6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG os_vif [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b85d915-02, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b85d915-02, col_values=(('external_ids', {'iface-id': '5b85d915-02dc-4e6b-9b28-e873d9b61c7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:b3:f0', 'vm-uuid': '322ac98d-d990-4841-b98c-74a53382efd6'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:16 user nova-compute[82184]: INFO os_vif [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02')
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:39:16 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] No VIF found with MAC fa:16:3e:13:b3:f0, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:39:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-03453cfe-bd04-4417-a945-a64e5b694f3e req-a27bb279-ca99-4976-8039-0d40f4e86a03 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:39:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-03453cfe-bd04-4417-a945-a64e5b694f3e req-a27bb279-ca99-4976-8039-0d40f4e86a03 service nova] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:39:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-03453cfe-bd04-4417-a945-a64e5b694f3e req-a27bb279-ca99-4976-8039-0d40f4e86a03 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:39:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-03453cfe-bd04-4417-a945-a64e5b694f3e req-a27bb279-ca99-4976-8039-0d40f4e86a03 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:39:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-03453cfe-bd04-4417-a945-a64e5b694f3e req-a27bb279-ca99-4976-8039-0d40f4e86a03 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] No waiting events found dispatching network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:39:17 user nova-compute[82184]: WARNING nova.compute.manager [req-03453cfe-bd04-4417-a945-a64e5b694f3e req-a27bb279-ca99-4976-8039-0d40f4e86a03 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received unexpected event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 02:39:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681267159.5001945, 322ac98d-d990-4841-b98c-74a53382efd6 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:39:19 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] VM Resumed (Lifecycle Event)
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:39:19 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Instance spawned successfully.
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:39:19 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681267159.505578, 322ac98d-d990-4841-b98c-74a53382efd6 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:39:19 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] VM Started (Lifecycle Event)
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:39:19 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ea37ad1-9e98-45d8-b0f2-63981971cfcc req-e4497453-68f8-4bfe-9ba3-445d44559462 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:39:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ea37ad1-9e98-45d8-b0f2-63981971cfcc req-e4497453-68f8-4bfe-9ba3-445d44559462 service nova] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:39:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ea37ad1-9e98-45d8-b0f2-63981971cfcc req-e4497453-68f8-4bfe-9ba3-445d44559462 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:39:19 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1ea37ad1-9e98-45d8-b0f2-63981971cfcc req-e4497453-68f8-4bfe-9ba3-445d44559462 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.compute.manager [req-1ea37ad1-9e98-45d8-b0f2-63981971cfcc req-e4497453-68f8-4bfe-9ba3-445d44559462 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] No waiting events found dispatching network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:39:19 user nova-compute[82184]: WARNING nova.compute.manager [req-1ea37ad1-9e98-45d8-b0f2-63981971cfcc req-e4497453-68f8-4bfe-9ba3-445d44559462 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received unexpected event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 02:39:19 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:39:20 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6b31e27e-7e71-40b9-bc1e-421f5b7e578b tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.602s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:39:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:39:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:39:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:23 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:39:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:39:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:39:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:39:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:39:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:39:26 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:39:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:39:27 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:39:27 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:39:27 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=26.24980926513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 322ac98d-d990-4841-b98c-74a53382efd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:39:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:39:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:32 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:39:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:39:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:39:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:39:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:39:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:39:36 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:39:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:39:37 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:39:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:39:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:39:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:39:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:39:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:41 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:39:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:39:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:40:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:40:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:40:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:40:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:40:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:40:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:40:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:40:22 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:40:25 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:40:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:40:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:40:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:40:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:40:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:40:26 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:40:26 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=82184) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 02:40:27 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:40:27 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:40:27 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=26.249027252197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 322ac98d-d990-4841-b98c-74a53382efd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:40:27 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:40:28 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:40:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:40:33 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:40:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:40:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:40:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:40:36 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:40:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:40:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:40:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:40:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:40:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:40:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:40:37 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:40:37 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:40:38 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:40:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:40:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:40:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:40:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:40:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:40:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:40:53 user nova-compute[82184]: INFO nova.compute.manager [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Detaching volume d7e20126-acbc-421c-9437-88099560832f
Apr 12 02:40:53 user nova-compute[82184]: INFO nova.virt.block_device [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Attempting to driver detach volume d7e20126-acbc-421c-9437-88099560832f from mountpoint /dev/vdc
Apr 12 02:40:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Attempting to detach device vdc from instance 322ac98d-d990-4841-b98c-74a53382efd6 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:40:53 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:40:53 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:40:53 user nova-compute[82184]:   <target dev="vdc" bus="virtio"/>
Apr 12 02:40:53 user nova-compute[82184]:   <serial>d7e20126-acbc-421c-9437-88099560832f</serial>
Apr 12 02:40:53 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 02:40:53 user nova-compute[82184]: </disk>
Apr 12 02:40:53 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:40:53 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Successfully detached device vdc from instance 322ac98d-d990-4841-b98c-74a53382efd6 from the persistent domain config.
Apr 12 02:40:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 322ac98d-d990-4841-b98c-74a53382efd6 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:40:53 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:40:53 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:40:53 user nova-compute[82184]:   <target dev="vdc" bus="virtio"/>
Apr 12 02:40:53 user nova-compute[82184]:   <serial>d7e20126-acbc-421c-9437-88099560832f</serial>
Apr 12 02:40:53 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 02:40:53 user nova-compute[82184]: </disk>
Apr 12 02:40:53 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681267253.937483, 322ac98d-d990-4841-b98c-74a53382efd6 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:40:53 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Successfully detached device vdc from instance 322ac98d-d990-4841-b98c-74a53382efd6 from the live domain config.
Apr 12 02:40:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rqocCnis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:40:53 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:40:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc440ab-33dc-4437-850b-17c965aff229]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:40:53 user nova-compute[82184]: No targets found.
Apr 12 02:40:53 user nova-compute[82184]: iSNS:
Apr 12 02:40:53 user nova-compute[82184]: No targets found.
Apr 12 02:40:53 user nova-compute[82184]: STATIC:
Apr 12 02:40:53 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f
Apr 12 02:40:53 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:40:53 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:40:53 user nova-compute[82184]: FIRMWARE:
Apr 12 02:40:53 user nova-compute[82184]: No targets found.
Apr 12 02:40:53 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:40:53 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:40:53 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fd610e-15c4-49d9-b5c0-7b5a1a1e5722]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:40:53 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d415ff-44a3-41ce-9279-69859106f475]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f (non-flash)
Apr 12 02:40:54 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f (non-flash)
Apr 12 02:40:54 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a81e1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d799ad-45ba-4313-bedb-4bc1ad60f808]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b47f330-fc9b-4444-818a-68e0a20d4ab3]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0d00f4-ec4b-44bd-9205-6fac3eae8900]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ac7371-0ca0-4085-a813-97f61843d981]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c8e1bf-8831-4804-a4b4-c1ed5dcbd86a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a28d27-f8cf-41d6-8fe6-1de8719bc7b8]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f, portal: 172.16.0.220,3260]
Apr 12 02:40:54 user nova-compute[82184]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f, portal: 172.16.0.220,3260] successful.
Apr 12 02:40:54 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7e20126-acbc-421c-9437-88099560832f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e6cfd8-a9cb-4aa6-86a7-be1cd6edd7c8]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] <== disconnect_volume: return (325ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:40:54 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:40:55 user nova-compute[82184]: DEBUG nova.objects.instance [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'flavor' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:40:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-479dbae3-de54-44c8-ac9d-b75d1a3d4267 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.732s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:40:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:40:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:41:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:41:21 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:22 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:28 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:41:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:41:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:41:28 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:41:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:41:29 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:41:29 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:41:29 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=26.248340606689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 322ac98d-d990-4841-b98c-74a53382efd6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:41:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:41:30 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:41:33 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:41:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:41:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:41:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:41:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:41:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:41:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:41:39 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:41:39 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:41:40 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [{"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:41:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-322ac98d-d990-4841-b98c-74a53382efd6" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:41:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:41:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:41:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:41:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:41:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:41:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:41:43 user nova-compute[82184]: INFO nova.compute.manager [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Terminating instance
Apr 12 02:41:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:41:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-eb500bef-47cc-4b43-8627-f30ece055494 req-3b9502a1-2917-4319-a39e-f703abfcdfb5 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-vif-unplugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-eb500bef-47cc-4b43-8627-f30ece055494 req-3b9502a1-2917-4319-a39e-f703abfcdfb5 service nova] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-eb500bef-47cc-4b43-8627-f30ece055494 req-3b9502a1-2917-4319-a39e-f703abfcdfb5 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-eb500bef-47cc-4b43-8627-f30ece055494 req-3b9502a1-2917-4319-a39e-f703abfcdfb5 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-eb500bef-47cc-4b43-8627-f30ece055494 req-3b9502a1-2917-4319-a39e-f703abfcdfb5 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] No waiting events found dispatching network-vif-unplugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-eb500bef-47cc-4b43-8627-f30ece055494 req-3b9502a1-2917-4319-a39e-f703abfcdfb5 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-vif-unplugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:44 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Instance destroyed successfully.
Apr 12 02:41:44 user nova-compute[82184]: DEBUG nova.objects.instance [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'resources' on Instance uuid 322ac98d-d990-4841-b98c-74a53382efd6 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T02:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1616847054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1616847054',id=44,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtoSQHC4yFKsSO0sQxkGPQvZnabNgsGvZ+PAGIKtWK5Je1BVouvWpb7OzRABncPbZnXWYtel/GG2A5dh7y+j1UOv9Y0st7v2BuEsWOkf4zfAMZhgkbwTSXP2ko7gvb2cQ==',key_name='tempest-keypair-2136830748',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-e9wdsozg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:39:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=322ac98d-d990-4841-b98c-74a53382efd6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "address": "fa:16:3e:13:b3:f0", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b85d915-02", "ovs_interfaceid": "5b85d915-02dc-4e6b-9b28-e873d9b61c7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG os_vif [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b85d915-02, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:44 user nova-compute[82184]: INFO os_vif [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:b3:f0,bridge_name='br-int',has_traffic_filtering=True,id=5b85d915-02dc-4e6b-9b28-e873d9b61c7d,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b85d915-02')
Apr 12 02:41:44 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Deleting instance files /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6_del
Apr 12 02:41:44 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Deletion of /opt/stack/data/nova/instances/322ac98d-d990-4841-b98c-74a53382efd6_del complete
Apr 12 02:41:44 user nova-compute[82184]: INFO nova.compute.manager [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 02:41:44 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:41:44 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:41:45 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:41:45 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Took 0.66 seconds to deallocate network for instance.
Apr 12 02:41:45 user nova-compute[82184]: DEBUG nova.compute.manager [req-8f5a389c-496b-4cad-b000-177b66a0e40a req-3fe6eb9e-0dda-4bcb-a711-aaf3f348d4a1 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-vif-deleted-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:41:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:41:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:41:45 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:41:45 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:41:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:41:45 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Deleted allocations for instance 322ac98d-d990-4841-b98c-74a53382efd6
Apr 12 02:41:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-8615e788-a47a-481c-a559-d5d6b5a4bbaf tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "322ac98d-d990-4841-b98c-74a53382efd6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.834s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:41:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-2d72afb0-7be5-4044-8865-99d751f2bbb7 req-03fedcaa-ab64-4786-8a48-d4e6b9539af1 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:41:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2d72afb0-7be5-4044-8865-99d751f2bbb7 req-03fedcaa-ab64-4786-8a48-d4e6b9539af1 service nova] Acquiring lock "322ac98d-d990-4841-b98c-74a53382efd6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:41:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2d72afb0-7be5-4044-8865-99d751f2bbb7 req-03fedcaa-ab64-4786-8a48-d4e6b9539af1 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:41:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2d72afb0-7be5-4044-8865-99d751f2bbb7 req-03fedcaa-ab64-4786-8a48-d4e6b9539af1 service nova] Lock "322ac98d-d990-4841-b98c-74a53382efd6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:41:46 user nova-compute[82184]: DEBUG nova.compute.manager [req-2d72afb0-7be5-4044-8865-99d751f2bbb7 req-03fedcaa-ab64-4786-8a48-d4e6b9539af1 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] No waiting events found dispatching network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:41:46 user nova-compute[82184]: WARNING nova.compute.manager [req-2d72afb0-7be5-4044-8865-99d751f2bbb7 req-03fedcaa-ab64-4786-8a48-d4e6b9539af1 service nova] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Received unexpected event network-vif-plugged-5b85d915-02dc-4e6b-9b28-e873d9b61c7d for instance with vm_state deleted and task_state None.
Apr 12 02:41:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:41:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:41:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:41:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:41:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:41:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:41:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:41:59 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681267304.4994252, 322ac98d-d990-4841-b98c-74a53382efd6 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:41:59 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] VM Stopped (Lifecycle Event)
Apr 12 02:41:59 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1a1625e3-9d79-4d46-aaea-ceae31f91657 None None] [instance: 322ac98d-d990-4841-b98c-74a53382efd6] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:41:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:42:04 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:22 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:42:24 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:30 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:42:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:42:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:42:30 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:42:31 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:42:31 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8899MB free_disk=26.267444610595703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:42:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:42:32 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:33 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:42:38 user nova-compute[82184]: INFO nova.compute.claims [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Claim successful on node user
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.network.neutron [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:42:38 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.policy [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b14e24aaf4e94584a824ff4886e89db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef2245b2b35848928e8e53439a1d9cb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:42:38 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Creating image(s)
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "/opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "/opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "/opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.155s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:42:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk 1073741824" returned: 0 in 0.047s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.network.neutron [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Successfully created port: da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Cannot resize image /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.objects.instance [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'migration_context' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Ensure instance console log exists: /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Skipping network cache update for instance because it is Building. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.network.neutron [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Successfully updated port: da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquired lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:42:39 user nova-compute[82184]: DEBUG nova.network.neutron [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.network.neutron [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-42a80218-f2c7-4648-b27e-cd844e36064e req-c65d4d46-9594-4e02-9365-84da0ec93b72 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-changed-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-42a80218-f2c7-4648-b27e-cd844e36064e req-c65d4d46-9594-4e02-9365-84da0ec93b72 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Refreshing instance network info cache due to event network-changed-da4f79fc-e83f-4c90-94a4-240d06066414. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-42a80218-f2c7-4648-b27e-cd844e36064e req-c65d4d46-9594-4e02-9365-84da0ec93b72 service nova] Acquiring lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.network.neutron [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Releasing lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance network_info: |[{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-42a80218-f2c7-4648-b27e-cd844e36064e req-c65d4d46-9594-4e02-9365-84da0ec93b72 service nova] Acquired lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.network.neutron [req-42a80218-f2c7-4648-b27e-cd844e36064e req-c65d4d46-9594-4e02-9365-84da0ec93b72 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Refreshing network info cache for port da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Start _get_guest_xml network_info=[{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:42:40 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:42:40 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452164160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452164160',id=45,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMQIrHz8sj+8MEnNCUkf4pCjv1uMpLhOgu3rcw8mO7hzQH8hWLqElQtlss11G+BYSe8GnwaJ5uvIv/A3TdUM5Ufms9xwOH+0sUifvltzb/i72wXhv4++3eQoDWz+m9bsQ==',key_name='tempest-keypair-1235094926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-xovt17sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=7811c126-63b5-48c7-854b-14b162f2ad7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.objects.instance [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'pci_devices' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:42:40 user nova-compute[82184]:   <uuid>7811c126-63b5-48c7-854b-14b162f2ad7a</uuid>
Apr 12 02:42:40 user nova-compute[82184]:   <name>instance-0000002d</name>
Apr 12 02:42:40 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:42:40 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:42:40 user nova-compute[82184]:   <metadata>
Apr 12 02:42:40 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:42:40 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:42:40 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1452164160</nova:name>
Apr 12 02:42:40 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:42:40</nova:creationTime>
Apr 12 02:42:40 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:42:40 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:42:40 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:42:40 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:42:40 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:42:40 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:42:40 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:42:40 user nova-compute[82184]:       <nova:owner>
Apr 12 02:42:40 user nova-compute[82184]:         <nova:user uuid="b14e24aaf4e94584a824ff4886e89db6">tempest-AttachVolumeShelveTestJSON-817837534-project-member</nova:user>
Apr 12 02:42:40 user nova-compute[82184]:         <nova:project uuid="ef2245b2b35848928e8e53439a1d9cb6">tempest-AttachVolumeShelveTestJSON-817837534</nova:project>
Apr 12 02:42:40 user nova-compute[82184]:       </nova:owner>
Apr 12 02:42:40 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:42:40 user nova-compute[82184]:       <nova:ports>
Apr 12 02:42:40 user nova-compute[82184]:         <nova:port uuid="da4f79fc-e83f-4c90-94a4-240d06066414">
Apr 12 02:42:40 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 02:42:40 user nova-compute[82184]:         </nova:port>
Apr 12 02:42:40 user nova-compute[82184]:       </nova:ports>
Apr 12 02:42:40 user nova-compute[82184]:     </nova:instance>
Apr 12 02:42:40 user nova-compute[82184]:   </metadata>
Apr 12 02:42:40 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:42:40 user nova-compute[82184]:     <system>
Apr 12 02:42:40 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:42:40 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:42:40 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:42:40 user nova-compute[82184]:       <entry name="serial">7811c126-63b5-48c7-854b-14b162f2ad7a</entry>
Apr 12 02:42:40 user nova-compute[82184]:       <entry name="uuid">7811c126-63b5-48c7-854b-14b162f2ad7a</entry>
Apr 12 02:42:40 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:42:40 user nova-compute[82184]:     </system>
Apr 12 02:42:40 user nova-compute[82184]:   </sysinfo>
Apr 12 02:42:40 user nova-compute[82184]:   <os>
Apr 12 02:42:40 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:42:40 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:42:40 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:42:40 user nova-compute[82184]:   </os>
Apr 12 02:42:40 user nova-compute[82184]:   <features>
Apr 12 02:42:40 user nova-compute[82184]:     <acpi/>
Apr 12 02:42:40 user nova-compute[82184]:     <apic/>
Apr 12 02:42:40 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:42:40 user nova-compute[82184]:   </features>
Apr 12 02:42:40 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:42:40 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:42:40 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:42:40 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:42:40 user nova-compute[82184]:   </clock>
Apr 12 02:42:40 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:42:40 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:42:40 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:42:40 user nova-compute[82184]:   </cpu>
Apr 12 02:42:40 user nova-compute[82184]:   <devices>
Apr 12 02:42:40 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:42:40 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:42:40 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk"/>
Apr 12 02:42:40 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:42:40 user nova-compute[82184]:     </disk>
Apr 12 02:42:40 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:42:40 user nova-compute[82184]:       <mac address="fa:16:3e:c6:5b:8a"/>
Apr 12 02:42:40 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:42:40 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:42:40 user nova-compute[82184]:       <target dev="tapda4f79fc-e8"/>
Apr 12 02:42:40 user nova-compute[82184]:     </interface>
Apr 12 02:42:40 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:42:40 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/console.log" append="off"/>
Apr 12 02:42:40 user nova-compute[82184]:     </serial>
Apr 12 02:42:40 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:42:40 user nova-compute[82184]:     <video>
Apr 12 02:42:40 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:42:40 user nova-compute[82184]:     </video>
Apr 12 02:42:40 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:42:40 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:42:40 user nova-compute[82184]:     </rng>
Apr 12 02:42:40 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:42:40 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:42:40 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:42:40 user nova-compute[82184]:     </memballoon>
Apr 12 02:42:40 user nova-compute[82184]:   </devices>
Apr 12 02:42:40 user nova-compute[82184]: </domain>
Apr 12 02:42:40 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452164160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452164160',id=45,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMQIrHz8sj+8MEnNCUkf4pCjv1uMpLhOgu3rcw8mO7hzQH8hWLqElQtlss11G+BYSe8GnwaJ5uvIv/A3TdUM5Ufms9xwOH+0sUifvltzb/i72wXhv4++3eQoDWz+m9bsQ==',key_name='tempest-keypair-1235094926',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-xovt17sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=7811c126-63b5-48c7-854b-14b162f2ad7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG os_vif [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda4f79fc-e8, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda4f79fc-e8, col_values=(('external_ids', {'iface-id': 'da4f79fc-e83f-4c90-94a4-240d06066414', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:5b:8a', 'vm-uuid': '7811c126-63b5-48c7-854b-14b162f2ad7a'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:40 user nova-compute[82184]: INFO os_vif [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8')
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] No VIF found with MAC fa:16:3e:c6:5b:8a, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:42:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:41 user nova-compute[82184]: DEBUG nova.network.neutron [req-42a80218-f2c7-4648-b27e-cd844e36064e req-c65d4d46-9594-4e02-9365-84da0ec93b72 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updated VIF entry in instance network info cache for port da4f79fc-e83f-4c90-94a4-240d06066414. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:42:41 user nova-compute[82184]: DEBUG nova.network.neutron [req-42a80218-f2c7-4648-b27e-cd844e36064e req-c65d4d46-9594-4e02-9365-84da0ec93b72 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:42:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-42a80218-f2c7-4648-b27e-cd844e36064e req-c65d4d46-9594-4e02-9365-84da0ec93b72 service nova] Releasing lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-7a95777f-c9ac-4562-b7fe-0b12f170cb41 req-762030ce-eb0f-44c3-8912-257936ef092d service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7a95777f-c9ac-4562-b7fe-0b12f170cb41 req-762030ce-eb0f-44c3-8912-257936ef092d service nova] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7a95777f-c9ac-4562-b7fe-0b12f170cb41 req-762030ce-eb0f-44c3-8912-257936ef092d service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7a95777f-c9ac-4562-b7fe-0b12f170cb41 req-762030ce-eb0f-44c3-8912-257936ef092d service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG nova.compute.manager [req-7a95777f-c9ac-4562-b7fe-0b12f170cb41 req-762030ce-eb0f-44c3-8912-257936ef092d service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] No waiting events found dispatching network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:42:42 user nova-compute[82184]: WARNING nova.compute.manager [req-7a95777f-c9ac-4562-b7fe-0b12f170cb41 req-762030ce-eb0f-44c3-8912-257936ef092d service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received unexpected event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 for instance with vm_state building and task_state spawning.
Apr 12 02:42:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681267364.1818957, 7811c126-63b5-48c7-854b-14b162f2ad7a => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:42:44 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] VM Resumed (Lifecycle Event)
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:42:44 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance spawned successfully.
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:42:44 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681267364.1833003, 7811c126-63b5-48c7-854b-14b162f2ad7a => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:42:44 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] VM Started (Lifecycle Event)
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:42:44 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:42:44 user nova-compute[82184]: INFO nova.compute.manager [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Took 5.65 seconds to spawn the instance on the hypervisor.
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:42:44 user nova-compute[82184]: INFO nova.compute.manager [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Took 6.19 seconds to build instance.
Apr 12 02:42:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-59033a05-2f6b-4694-805a-fbfe5f20cb18 tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.290s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-2cae7110-0a62-4765-9cb1-8ec79892e379 req-e5b0cf62-a58d-4c33-88d1-6793a16cff44 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2cae7110-0a62-4765-9cb1-8ec79892e379 req-e5b0cf62-a58d-4c33-88d1-6793a16cff44 service nova] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2cae7110-0a62-4765-9cb1-8ec79892e379 req-e5b0cf62-a58d-4c33-88d1-6793a16cff44 service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-2cae7110-0a62-4765-9cb1-8ec79892e379 req-e5b0cf62-a58d-4c33-88d1-6793a16cff44 service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:42:44 user nova-compute[82184]: DEBUG nova.compute.manager [req-2cae7110-0a62-4765-9cb1-8ec79892e379 req-e5b0cf62-a58d-4c33-88d1-6793a16cff44 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] No waiting events found dispatching network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:42:44 user nova-compute[82184]: WARNING nova.compute.manager [req-2cae7110-0a62-4765-9cb1-8ec79892e379 req-e5b0cf62-a58d-4c33-88d1-6793a16cff44 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received unexpected event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 for instance with vm_state active and task_state None.
Apr 12 02:42:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:45 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:42:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:42:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:43:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:43:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:43:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:43:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:43:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:43:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:24 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:43:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:43:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:43:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:43:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:43:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:26 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:43:27 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:28 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:43:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:31 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:43:31 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:43:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:43:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:43:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:43:31 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:43:31 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:43:32 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:43:32 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:43:32 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=26.245880126953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 7811c126-63b5-48c7-854b-14b162f2ad7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:43:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:43:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:43:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:43:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:43:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:43:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:43:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:43:39 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:43:39 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:43:40 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:43:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:43:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:43:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:41 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:43:41 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:43:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:43:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:43:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:43:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:43:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:43:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:43:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:43:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:43:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:43:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:43:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:43:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:43:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:43:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:43:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:43:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:44:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:44:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:44:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:44:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:44:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:44:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:44:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:44:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:44:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:44:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:25 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:44:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:44:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:44:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:44:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:44:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:44:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:28 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:44:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-3e129a4f-100f-48d3-84cf-a9a610e237c9 req-724bc48b-7d3c-4d44-a219-d0aea2da0acf service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-changed-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:44:29 user nova-compute[82184]: DEBUG nova.compute.manager [req-3e129a4f-100f-48d3-84cf-a9a610e237c9 req-724bc48b-7d3c-4d44-a219-d0aea2da0acf service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Refreshing instance network info cache due to event network-changed-da4f79fc-e83f-4c90-94a4-240d06066414. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:44:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3e129a4f-100f-48d3-84cf-a9a610e237c9 req-724bc48b-7d3c-4d44-a219-d0aea2da0acf service nova] Acquiring lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:44:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3e129a4f-100f-48d3-84cf-a9a610e237c9 req-724bc48b-7d3c-4d44-a219-d0aea2da0acf service nova] Acquired lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:44:29 user nova-compute[82184]: DEBUG nova.network.neutron [req-3e129a4f-100f-48d3-84cf-a9a610e237c9 req-724bc48b-7d3c-4d44-a219-d0aea2da0acf service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Refreshing network info cache for port da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:44:29 user nova-compute[82184]: DEBUG nova.network.neutron [req-3e129a4f-100f-48d3-84cf-a9a610e237c9 req-724bc48b-7d3c-4d44-a219-d0aea2da0acf service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updated VIF entry in instance network info cache for port da4f79fc-e83f-4c90-94a4-240d06066414. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:44:29 user nova-compute[82184]: DEBUG nova.network.neutron [req-3e129a4f-100f-48d3-84cf-a9a610e237c9 req-724bc48b-7d3c-4d44-a219-d0aea2da0acf service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:44:29 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-3e129a4f-100f-48d3-84cf-a9a610e237c9 req-724bc48b-7d3c-4d44-a219-d0aea2da0acf service nova] Releasing lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:44:29 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:44:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:44:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:44:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:44:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:44:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:44:31 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.003s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:44:31 user nova-compute[82184]: INFO nova.compute.manager [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Shelving
Apr 12 02:44:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-7d62b56e-c80d-4f89-a475-def1537bd77a req-b12c264d-04fc-46a2-acae-676b9167c910 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-vif-unplugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7d62b56e-c80d-4f89-a475-def1537bd77a req-b12c264d-04fc-46a2-acae-676b9167c910 service nova] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7d62b56e-c80d-4f89-a475-def1537bd77a req-b12c264d-04fc-46a2-acae-676b9167c910 service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7d62b56e-c80d-4f89-a475-def1537bd77a req-b12c264d-04fc-46a2-acae-676b9167c910 service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-7d62b56e-c80d-4f89-a475-def1537bd77a req-b12c264d-04fc-46a2-acae-676b9167c910 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] No waiting events found dispatching network-vif-unplugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:44:32 user nova-compute[82184]: WARNING nova.compute.manager [req-7d62b56e-c80d-4f89-a475-def1537bd77a req-b12c264d-04fc-46a2-acae-676b9167c910 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received unexpected event network-vif-unplugged-da4f79fc-e83f-4c90-94a4-240d06066414 for instance with vm_state active and task_state shelving.
Apr 12 02:44:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:32 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance destroyed successfully.
Apr 12 02:44:32 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Beginning cold snapshot process
Apr 12 02:44:32 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk /opt/stack/data/nova/instances/snapshots/tmpfibuc2o7/66b76cee97a14d7c8ae8a547848b52ee {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:44:32 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk /opt/stack/data/nova/instances/snapshots/tmpfibuc2o7/66b76cee97a14d7c8ae8a547848b52ee" returned: 0 in 0.361s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:44:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Snapshot extracted, beginning image upload
Apr 12 02:44:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:44:33 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:44:33 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:44:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8871MB free_disk=26.243576049804688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 7811c126-63b5-48c7-854b-14b162f2ad7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:44:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:44:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-1bbf81fb-e795-4f6e-8d40-b997a81556b1 req-d6bf1ce0-29fb-40d9-910d-e243ec2eba8f service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:44:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1bbf81fb-e795-4f6e-8d40-b997a81556b1 req-d6bf1ce0-29fb-40d9-910d-e243ec2eba8f service nova] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:44:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1bbf81fb-e795-4f6e-8d40-b997a81556b1 req-d6bf1ce0-29fb-40d9-910d-e243ec2eba8f service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:44:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-1bbf81fb-e795-4f6e-8d40-b997a81556b1 req-d6bf1ce0-29fb-40d9-910d-e243ec2eba8f service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:44:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-1bbf81fb-e795-4f6e-8d40-b997a81556b1 req-d6bf1ce0-29fb-40d9-910d-e243ec2eba8f service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] No waiting events found dispatching network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:44:34 user nova-compute[82184]: WARNING nova.compute.manager [req-1bbf81fb-e795-4f6e-8d40-b997a81556b1 req-d6bf1ce0-29fb-40d9-910d-e243ec2eba8f service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received unexpected event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 02:44:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:44:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:44:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Snapshot image upload complete
Apr 12 02:44:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:44:35 user nova-compute[82184]: INFO nova.compute.manager [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Shelve offloading
Apr 12 02:44:35 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance destroyed successfully.
Apr 12 02:44:35 user nova-compute[82184]: DEBUG nova.compute.manager [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:44:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:44:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquired lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:44:35 user nova-compute[82184]: DEBUG nova.network.neutron [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:44:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.network.neutron [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Releasing lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:44:36 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance destroyed successfully.
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'resources' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452164160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452164160',id=45,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMQIrHz8sj+8MEnNCUkf4pCjv1uMpLhOgu3rcw8mO7hzQH8hWLqElQtlss11G+BYSe8GnwaJ5uvIv/A3TdUM5Ufms9xwOH+0sUifvltzb/i72wXhv4++3eQoDWz+m9bsQ==',key_name='tempest-keypair-1235094926',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:42:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-xovt17sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member',shelved_at='2023-04-12T02:44:35.511655',shelved_host='user',shelved_image_id='8cdcaee9-e8e8-4646-8ad6-90cce66813ec'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=7811c126-63b5-48c7-854b-14b162f2ad7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG os_vif [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda4f79fc-e8, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-58a0ca7c-78de-4a81-adce-3d8486b54856 req-2d4ca3f9-9030-410c-9945-9341c91bdf50 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-changed-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.compute.manager [req-58a0ca7c-78de-4a81-adce-3d8486b54856 req-2d4ca3f9-9030-410c-9945-9341c91bdf50 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Refreshing instance network info cache due to event network-changed-da4f79fc-e83f-4c90-94a4-240d06066414. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-58a0ca7c-78de-4a81-adce-3d8486b54856 req-2d4ca3f9-9030-410c-9945-9341c91bdf50 service nova] Acquiring lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-58a0ca7c-78de-4a81-adce-3d8486b54856 req-2d4ca3f9-9030-410c-9945-9341c91bdf50 service nova] Acquired lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.network.neutron [req-58a0ca7c-78de-4a81-adce-3d8486b54856 req-2d4ca3f9-9030-410c-9945-9341c91bdf50 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Refreshing network info cache for port da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:44:36 user nova-compute[82184]: INFO os_vif [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8')
Apr 12 02:44:36 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Deleting instance files /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a_del
Apr 12 02:44:36 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Deletion of /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a_del complete
Apr 12 02:44:36 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Deleted allocations for instance 7811c126-63b5-48c7-854b-14b162f2ad7a
Apr 12 02:44:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.objects.instance [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'numa_topology' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:44:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.097s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:44:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-1bccc319-7b9a-4152-81c0-6da421b13d3e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.450s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:44:37 user nova-compute[82184]: DEBUG nova.network.neutron [req-58a0ca7c-78de-4a81-adce-3d8486b54856 req-2d4ca3f9-9030-410c-9945-9341c91bdf50 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updated VIF entry in instance network info cache for port da4f79fc-e83f-4c90-94a4-240d06066414. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:44:37 user nova-compute[82184]: DEBUG nova.network.neutron [req-58a0ca7c-78de-4a81-adce-3d8486b54856 req-2d4ca3f9-9030-410c-9945-9341c91bdf50 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:44:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-58a0ca7c-78de-4a81-adce-3d8486b54856 req-2d4ca3f9-9030-410c-9945-9341c91bdf50 service nova] Releasing lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:44:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:44:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:44:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:44:40 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:44:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:42 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:44:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:44:45 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:44:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:47 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681267472.4679737, 7811c126-63b5-48c7-854b-14b162f2ad7a => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:44:47 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] VM Stopped (Lifecycle Event)
Apr 12 02:44:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-32a75124-e71c-4f4a-8ac9-9121656471d0 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:44:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:44:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:44:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:45:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:45:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:45:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:45:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:45:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:45:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:45:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:45:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:45:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:45:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:45:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:45:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:45:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:45:27 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:45:29 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:45:30 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:45:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:32 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:45:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:45:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:45:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:45:32 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:45:33 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:45:33 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:45:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=26.228084564208984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:45:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:45:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:45:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:45:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:45:33 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:45:33 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:45:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:45:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:45:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:45:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:45:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:45:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:45:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:45:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:45:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:45:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:45:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:45:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:45:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:45:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:45:41 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:42 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:45:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:45:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:45:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:45:44 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:45:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:45:46 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:45:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:45:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:45:56 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:46:01 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:46:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:46:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:46:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:46:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:46:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:46:11 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:16 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:46:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:46:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:46:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:46:21 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:46:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:46:25 user nova-compute[82184]: INFO nova.compute.manager [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Unshelving
Apr 12 02:46:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:46:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:46:25 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'pci_requests' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:46:25 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'numa_topology' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:46:25 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:46:25 user nova-compute[82184]: INFO nova.compute.claims [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Claim successful on node user
Apr 12 02:46:25 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:46:25 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:46:25 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:46:25 user nova-compute[82184]: INFO nova.network.neutron [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating port da4f79fc-e83f-4c90-94a4-240d06066414 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquired lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG nova.compute.manager [req-394b5d14-1481-4479-88f9-32b40955fd86 req-3b6d40e5-dd3e-4e97-8d3a-38071620fbe4 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-changed-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG nova.compute.manager [req-394b5d14-1481-4479-88f9-32b40955fd86 req-3b6d40e5-dd3e-4e97-8d3a-38071620fbe4 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Refreshing instance network info cache due to event network-changed-da4f79fc-e83f-4c90-94a4-240d06066414. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-394b5d14-1481-4479-88f9-32b40955fd86 req-3b6d40e5-dd3e-4e97-8d3a-38071620fbe4 service nova] Acquiring lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG nova.network.neutron [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Releasing lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:46:26 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Creating image(s)
Apr 12 02:46:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "/opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "/opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "/opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-394b5d14-1481-4479-88f9-32b40955fd86 req-3b6d40e5-dd3e-4e97-8d3a-38071620fbe4 service nova] Acquired lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG nova.network.neutron [req-394b5d14-1481-4479-88f9-32b40955fd86 req-3b6d40e5-dd3e-4e97-8d3a-38071620fbe4 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Refreshing network info cache for port da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "9462d4b5d540b776051b5e975f1bbab78464629c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:46:26 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "9462d4b5d540b776051b5e975f1bbab78464629c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:46:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c.part --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:27 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c.part --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:27 user nova-compute[82184]: DEBUG nova.virt.images [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] 8cdcaee9-e8e8-4646-8ad6-90cce66813ec was qcow2, converting to raw {{(pid=82184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 02:46:27 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:46:27 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c.part /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c.converted {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:27 user nova-compute[82184]: DEBUG nova.network.neutron [req-394b5d14-1481-4479-88f9-32b40955fd86 req-3b6d40e5-dd3e-4e97-8d3a-38071620fbe4 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updated VIF entry in instance network info cache for port da4f79fc-e83f-4c90-94a4-240d06066414. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:46:27 user nova-compute[82184]: DEBUG nova.network.neutron [req-394b5d14-1481-4479-88f9-32b40955fd86 req-3b6d40e5-dd3e-4e97-8d3a-38071620fbe4 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-394b5d14-1481-4479-88f9-32b40955fd86 req-3b6d40e5-dd3e-4e97-8d3a-38071620fbe4 service nova] Releasing lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c.part /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c.converted" returned: 0 in 0.285s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c.converted --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c.converted --force-share --output=json" returned: 0 in 0.126s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "9462d4b5d540b776051b5e975f1bbab78464629c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.299s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "9462d4b5d540b776051b5e975f1bbab78464629c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "9462d4b5d540b776051b5e975f1bbab78464629c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c,backing_fmt=raw /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c,backing_fmt=raw /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk 1073741824" returned: 0 in 0.049s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "9462d4b5d540b776051b5e975f1bbab78464629c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9462d4b5d540b776051b5e975f1bbab78464629c --force-share --output=json" returned: 0 in 0.131s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'migration_context' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:46:28 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Rebasing disk image.
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:28 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 -F raw /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 -F raw /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk" returned: 0 in 1.725s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Ensure instance console log exists: /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Start _get_guest_xml network_info=[{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='28559cc1012a758c359ba3a5f0600b98',container_format='bare',created_at=2023-04-12T02:44:32Z,direct_url=<?>,disk_format='qcow2',id=8cdcaee9-e8e8-4646-8ad6-90cce66813ec,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1452164160-shelved',owner='ef2245b2b35848928e8e53439a1d9cb6',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T02:44:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:46:30 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:46:30 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='28559cc1012a758c359ba3a5f0600b98',container_format='bare',created_at=2023-04-12T02:44:32Z,direct_url=<?>,disk_format='qcow2',id=8cdcaee9-e8e8-4646-8ad6-90cce66813ec,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1452164160-shelved',owner='ef2245b2b35848928e8e53439a1d9cb6',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T02:44:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T02:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452164160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452164160',id=45,image_ref='8cdcaee9-e8e8-4646-8ad6-90cce66813ec',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1235094926',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:42:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-xovt17sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member',shelved_at='2023-04-12T02:44:35.511655',shelved_host='user',shelved_image_id='8cdcaee9-e8e8-4646-8ad6-90cce66813ec'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=7811c126-63b5-48c7-854b-14b162f2ad7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.objects.instance [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'pci_devices' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:46:30 user nova-compute[82184]:   <uuid>7811c126-63b5-48c7-854b-14b162f2ad7a</uuid>
Apr 12 02:46:30 user nova-compute[82184]:   <name>instance-0000002d</name>
Apr 12 02:46:30 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:46:30 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:46:30 user nova-compute[82184]:   <metadata>
Apr 12 02:46:30 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:46:30 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:46:30 user nova-compute[82184]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1452164160</nova:name>
Apr 12 02:46:30 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:46:30</nova:creationTime>
Apr 12 02:46:30 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:46:30 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:46:30 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:46:30 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:46:30 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:46:30 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:46:30 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:46:30 user nova-compute[82184]:       <nova:owner>
Apr 12 02:46:30 user nova-compute[82184]:         <nova:user uuid="b14e24aaf4e94584a824ff4886e89db6">tempest-AttachVolumeShelveTestJSON-817837534-project-member</nova:user>
Apr 12 02:46:30 user nova-compute[82184]:         <nova:project uuid="ef2245b2b35848928e8e53439a1d9cb6">tempest-AttachVolumeShelveTestJSON-817837534</nova:project>
Apr 12 02:46:30 user nova-compute[82184]:       </nova:owner>
Apr 12 02:46:30 user nova-compute[82184]:       <nova:root type="image" uuid="8cdcaee9-e8e8-4646-8ad6-90cce66813ec"/>
Apr 12 02:46:30 user nova-compute[82184]:       <nova:ports>
Apr 12 02:46:30 user nova-compute[82184]:         <nova:port uuid="da4f79fc-e83f-4c90-94a4-240d06066414">
Apr 12 02:46:30 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 02:46:30 user nova-compute[82184]:         </nova:port>
Apr 12 02:46:30 user nova-compute[82184]:       </nova:ports>
Apr 12 02:46:30 user nova-compute[82184]:     </nova:instance>
Apr 12 02:46:30 user nova-compute[82184]:   </metadata>
Apr 12 02:46:30 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:46:30 user nova-compute[82184]:     <system>
Apr 12 02:46:30 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:46:30 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:46:30 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:46:30 user nova-compute[82184]:       <entry name="serial">7811c126-63b5-48c7-854b-14b162f2ad7a</entry>
Apr 12 02:46:30 user nova-compute[82184]:       <entry name="uuid">7811c126-63b5-48c7-854b-14b162f2ad7a</entry>
Apr 12 02:46:30 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:46:30 user nova-compute[82184]:     </system>
Apr 12 02:46:30 user nova-compute[82184]:   </sysinfo>
Apr 12 02:46:30 user nova-compute[82184]:   <os>
Apr 12 02:46:30 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:46:30 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:46:30 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:46:30 user nova-compute[82184]:   </os>
Apr 12 02:46:30 user nova-compute[82184]:   <features>
Apr 12 02:46:30 user nova-compute[82184]:     <acpi/>
Apr 12 02:46:30 user nova-compute[82184]:     <apic/>
Apr 12 02:46:30 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:46:30 user nova-compute[82184]:   </features>
Apr 12 02:46:30 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:46:30 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:46:30 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:46:30 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:46:30 user nova-compute[82184]:   </clock>
Apr 12 02:46:30 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:46:30 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:46:30 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:46:30 user nova-compute[82184]:   </cpu>
Apr 12 02:46:30 user nova-compute[82184]:   <devices>
Apr 12 02:46:30 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:46:30 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:46:30 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk"/>
Apr 12 02:46:30 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:46:30 user nova-compute[82184]:     </disk>
Apr 12 02:46:30 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:46:30 user nova-compute[82184]:       <mac address="fa:16:3e:c6:5b:8a"/>
Apr 12 02:46:30 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:46:30 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:46:30 user nova-compute[82184]:       <target dev="tapda4f79fc-e8"/>
Apr 12 02:46:30 user nova-compute[82184]:     </interface>
Apr 12 02:46:30 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:46:30 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/console.log" append="off"/>
Apr 12 02:46:30 user nova-compute[82184]:     </serial>
Apr 12 02:46:30 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:46:30 user nova-compute[82184]:     <video>
Apr 12 02:46:30 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:46:30 user nova-compute[82184]:     </video>
Apr 12 02:46:30 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:46:30 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:46:30 user nova-compute[82184]:     </rng>
Apr 12 02:46:30 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:46:30 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:46:30 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:46:30 user nova-compute[82184]:     </memballoon>
Apr 12 02:46:30 user nova-compute[82184]:   </devices>
Apr 12 02:46:30 user nova-compute[82184]: </domain>
Apr 12 02:46:30 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T02:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452164160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452164160',id=45,image_ref='8cdcaee9-e8e8-4646-8ad6-90cce66813ec',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1235094926',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:42:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-xovt17sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member',shelved_at='2023-04-12T02:44:35.511655',shelved_host='user',shelved_image_id='8cdcaee9-e8e8-4646-8ad6-90cce66813ec'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=7811c126-63b5-48c7-854b-14b162f2ad7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG os_vif [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda4f79fc-e8, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda4f79fc-e8, col_values=(('external_ids', {'iface-id': 'da4f79fc-e83f-4c90-94a4-240d06066414', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:5b:8a', 'vm-uuid': '7811c126-63b5-48c7-854b-14b162f2ad7a'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:30 user nova-compute[82184]: INFO os_vif [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8')
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] No VIF found with MAC fa:16:3e:c6:5b:8a, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:46:30 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-c8024e45-d337-45b3-897c-ffc4fa2d945c req-3c8df1be-27ba-41e0-8502-955da306d1ea service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c8024e45-d337-45b3-897c-ffc4fa2d945c req-3c8df1be-27ba-41e0-8502-955da306d1ea service nova] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c8024e45-d337-45b3-897c-ffc4fa2d945c req-3c8df1be-27ba-41e0-8502-955da306d1ea service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c8024e45-d337-45b3-897c-ffc4fa2d945c req-3c8df1be-27ba-41e0-8502-955da306d1ea service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-c8024e45-d337-45b3-897c-ffc4fa2d945c req-3c8df1be-27ba-41e0-8502-955da306d1ea service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] No waiting events found dispatching network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:46:32 user nova-compute[82184]: WARNING nova.compute.manager [req-c8024e45-d337-45b3-897c-ffc4fa2d945c req-3c8df1be-27ba-41e0-8502-955da306d1ea service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received unexpected event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 02:46:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:32 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:33 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:46:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:46:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:46:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:46:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681267594.1224353, 7811c126-63b5-48c7-854b-14b162f2ad7a => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:46:34 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] VM Resumed (Lifecycle Event)
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:46:34 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance spawned successfully.
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:46:34 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681267594.125905, 7811c126-63b5-48c7-854b-14b162f2ad7a => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:46:34 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] VM Started (Lifecycle Event)
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:46:34 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-fff13747-e972-4988-a36a-36c8c10e4614 req-8b1a3719-6dd6-4246-9118-099e39ab0cd5 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fff13747-e972-4988-a36a-36c8c10e4614 req-8b1a3719-6dd6-4246-9118-099e39ab0cd5 service nova] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fff13747-e972-4988-a36a-36c8c10e4614 req-8b1a3719-6dd6-4246-9118-099e39ab0cd5 service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-fff13747-e972-4988-a36a-36c8c10e4614 req-8b1a3719-6dd6-4246-9118-099e39ab0cd5 service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-fff13747-e972-4988-a36a-36c8c10e4614 req-8b1a3719-6dd6-4246-9118-099e39ab0cd5 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] No waiting events found dispatching network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:46:34 user nova-compute[82184]: WARNING nova.compute.manager [req-fff13747-e972-4988-a36a-36c8c10e4614 req-8b1a3719-6dd6-4246-9118-099e39ab0cd5 service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received unexpected event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 02:46:34 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:46:34 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=26.130352020263672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (ab0d5e15-c70b-4898-ad6b-82542f647a5e): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1705}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-4ab4c41a-680c-4257-b402-0373a8062ecd tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.536s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:46:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:46:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:46:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:46:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:42 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:46:42 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:46:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:46:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:46:42 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:46:42 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:46:43 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:46:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:46:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:46:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:46:45 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:45 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:46:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:46:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:46:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:47:00 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:00 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:47:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:03 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:47:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:47:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:47:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:47:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:47:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:15 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:22 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:23 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Triggering sync for uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 02:47:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:47:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:47:23 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:47:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:47:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:47:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:27 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:47:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:47:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:30 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:33 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:47:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:47:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:47:33 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:47:33 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:47:34 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:47:34 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=26.201305389404297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 7811c126-63b5-48c7-854b-14b162f2ad7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:47:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:47:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:47:44 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:47:44 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:47:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:47:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:47:44 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:47:44 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:47:45 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [{"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:47:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-7811c126-63b5-48c7-854b-14b162f2ad7a" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:47:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:47:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:47:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:47:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:47:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:47:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:47:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:47:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:47:52 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:47:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:48:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:48:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:48:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:48:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:48:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:48:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:48:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:48:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:48:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:48:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:48:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:48:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:48:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:48:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:48:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:48:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:48:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:48:14 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:48:14 user nova-compute[82184]: INFO nova.compute.manager [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Terminating instance
Apr 12 02:48:14 user nova-compute[82184]: DEBUG nova.compute.manager [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:48:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-4127c731-dc37-47ea-9e0f-e1fd1b68a1a3 req-5abc9e66-1d80-4151-b74a-f937ab927d5f service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-vif-unplugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4127c731-dc37-47ea-9e0f-e1fd1b68a1a3 req-5abc9e66-1d80-4151-b74a-f937ab927d5f service nova] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4127c731-dc37-47ea-9e0f-e1fd1b68a1a3 req-5abc9e66-1d80-4151-b74a-f937ab927d5f service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-4127c731-dc37-47ea-9e0f-e1fd1b68a1a3 req-5abc9e66-1d80-4151-b74a-f937ab927d5f service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-4127c731-dc37-47ea-9e0f-e1fd1b68a1a3 req-5abc9e66-1d80-4151-b74a-f937ab927d5f service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] No waiting events found dispatching network-vif-unplugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG nova.compute.manager [req-4127c731-dc37-47ea-9e0f-e1fd1b68a1a3 req-5abc9e66-1d80-4151-b74a-f937ab927d5f service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-vif-unplugged-da4f79fc-e83f-4c90-94a4-240d06066414 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:15 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Instance destroyed successfully.
Apr 12 02:48:15 user nova-compute[82184]: DEBUG nova.objects.instance [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lazy-loading 'resources' on Instance uuid 7811c126-63b5-48c7-854b-14b162f2ad7a {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T02:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1452164160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1452164160',id=45,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMQIrHz8sj+8MEnNCUkf4pCjv1uMpLhOgu3rcw8mO7hzQH8hWLqElQtlss11G+BYSe8GnwaJ5uvIv/A3TdUM5Ufms9xwOH+0sUifvltzb/i72wXhv4++3eQoDWz+m9bsQ==',key_name='tempest-keypair-1235094926',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:46:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef2245b2b35848928e8e53439a1d9cb6',ramdisk_id='',reservation_id='r-xovt17sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-817837534',owner_user_name='tempest-AttachVolumeShelveTestJSON-817837534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b14e24aaf4e94584a824ff4886e89db6',uuid=7811c126-63b5-48c7-854b-14b162f2ad7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converting VIF {"id": "da4f79fc-e83f-4c90-94a4-240d06066414", "address": "fa:16:3e:c6:5b:8a", "network": {"id": "ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1837049574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef2245b2b35848928e8e53439a1d9cb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda4f79fc-e8", "ovs_interfaceid": "da4f79fc-e83f-4c90-94a4-240d06066414", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG os_vif [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda4f79fc-e8, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:48:15 user nova-compute[82184]: INFO os_vif [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:5b:8a,bridge_name='br-int',has_traffic_filtering=True,id=da4f79fc-e83f-4c90-94a4-240d06066414,network=Network(ab5d72ac-f30c-4d4d-ad2c-fb6b6f871e09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda4f79fc-e8')
Apr 12 02:48:15 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Deleting instance files /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a_del
Apr 12 02:48:15 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Deletion of /opt/stack/data/nova/instances/7811c126-63b5-48c7-854b-14b162f2ad7a_del complete
Apr 12 02:48:15 user nova-compute[82184]: INFO nova.compute.manager [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Took 1.03 seconds to destroy the instance on the hypervisor.
Apr 12 02:48:15 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:48:15 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:48:16 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:48:16 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Took 0.76 seconds to deallocate network for instance.
Apr 12 02:48:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:48:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:48:16 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:48:16 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:48:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:48:16 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Deleted allocations for instance 7811c126-63b5-48c7-854b-14b162f2ad7a
Apr 12 02:48:16 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-ed778c9c-ca58-424e-84ae-afd811c1850e tempest-AttachVolumeShelveTestJSON-817837534 tempest-AttachVolumeShelveTestJSON-817837534-project-member] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.080s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:48:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-968303d2-3326-425b-9705-0e7d56baf529 req-baef8dc7-aaf0-4401-9b2d-e5f385e18c5a service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:48:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-968303d2-3326-425b-9705-0e7d56baf529 req-baef8dc7-aaf0-4401-9b2d-e5f385e18c5a service nova] Acquiring lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:48:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-968303d2-3326-425b-9705-0e7d56baf529 req-baef8dc7-aaf0-4401-9b2d-e5f385e18c5a service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:48:17 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-968303d2-3326-425b-9705-0e7d56baf529 req-baef8dc7-aaf0-4401-9b2d-e5f385e18c5a service nova] Lock "7811c126-63b5-48c7-854b-14b162f2ad7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:48:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-968303d2-3326-425b-9705-0e7d56baf529 req-baef8dc7-aaf0-4401-9b2d-e5f385e18c5a service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] No waiting events found dispatching network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:48:17 user nova-compute[82184]: WARNING nova.compute.manager [req-968303d2-3326-425b-9705-0e7d56baf529 req-baef8dc7-aaf0-4401-9b2d-e5f385e18c5a service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received unexpected event network-vif-plugged-da4f79fc-e83f-4c90-94a4-240d06066414 for instance with vm_state deleted and task_state None.
Apr 12 02:48:17 user nova-compute[82184]: DEBUG nova.compute.manager [req-968303d2-3326-425b-9705-0e7d56baf529 req-baef8dc7-aaf0-4401-9b2d-e5f385e18c5a service nova] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Received event network-vif-deleted-da4f79fc-e83f-4c90-94a4-240d06066414 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:48:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:27 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:48:30 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681267695.759296, 7811c126-63b5-48c7-854b-14b162f2ad7a => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:48:30 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] VM Stopped (Lifecycle Event)
Apr 12 02:48:30 user nova-compute[82184]: DEBUG nova.compute.manager [None req-63b1606c-7455-4b65-9219-1b51a6d0870a None None] [instance: 7811c126-63b5-48c7-854b-14b162f2ad7a] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:48:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:31 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:48:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:48:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:48:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:48:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:48:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:48:34 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:48:35 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:48:35 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:48:35 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8905MB free_disk=26.22039031982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:48:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:48:38 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:48:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:48:45 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:48:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:48:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:48:45 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:48:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:48:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:48:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:48:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:48:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:48:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:48:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:48:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:48:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:48:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:49:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:49:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:49:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:49:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:49:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:49:06 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:49:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:49:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:49:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:49:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:49:29 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:49:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:49:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:49:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:49:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:49:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:33 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:49:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:49:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:49:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:49:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:49:35 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:49:35 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:49:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:36 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:36 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:49:36 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:49:36 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8881MB free_disk=26.217994689941406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:49:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:49:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:49:36 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:49:36 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:49:36 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:49:36 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:49:36 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:49:36 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:49:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:38 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:49:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:49:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:40 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:45 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:49:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:49:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:49:46 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:49:47 user nova-compute[82184]: INFO nova.compute.claims [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Claim successful on node user
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.220s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:49:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.policy [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5ed29e7a68045d1bf0b98f416adcb2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6594c28fbe004babb03de341f082b858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:49:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Creating image(s)
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "/opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "/opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "/opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "95f71f969739e39e07ee6197f212e1b4213ce690" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk 1073741824" returned: 0 in 0.057s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "95f71f969739e39e07ee6197f212e1b4213ce690" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:49:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk. size=1073741824 {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.virt.disk.api [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Cannot resize image /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk to a smaller size. {{(pid=82184) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'migration_context' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Successfully created port: 55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Ensure instance console log exists: /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Successfully updated port: 55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquired lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-97edf491-15c8-4626-afaa-8114bb406bdb req-f39bf3de-f288-48bb-9c7a-a62002d24e00 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received event network-changed-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.compute.manager [req-97edf491-15c8-4626-afaa-8114bb406bdb req-f39bf3de-f288-48bb-9c7a-a62002d24e00 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Refreshing instance network info cache due to event network-changed-55871f74-ac4f-4e6f-86cb-5f593dd8de7d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-97edf491-15c8-4626-afaa-8114bb406bdb req-f39bf3de-f288-48bb-9c7a-a62002d24e00 service nova] Acquiring lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:49:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating instance_info_cache with network_info: [{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Releasing lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Instance network_info: |[{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-97edf491-15c8-4626-afaa-8114bb406bdb req-f39bf3de-f288-48bb-9c7a-a62002d24e00 service nova] Acquired lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-97edf491-15c8-4626-afaa-8114bb406bdb req-f39bf3de-f288-48bb-9c7a-a62002d24e00 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Refreshing network info cache for port 55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Start _get_guest_xml network_info=[{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': '16f93c82-82f4-4843-b632-b6b6fe0b6c16'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:49:49 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:49:49 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T01:46:04Z,direct_url=<?>,disk_format='qcow2',id=16f93c82-82f4-4843-b632-b6b6fe0b6c16,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f64ce7ca5af542c6bac7486e15930969',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T01:46:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-375589421',display_name='tempest-TestStampPattern-server-375589421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-375589421',id=46,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpyzmcRX9rlNwf8L3npzKG+KhZsGBYg2FMRQESss2fLWTR7mB/j7XujY+I5ifJXOZVNKSQj7zwTGJjBzU1DUaSm2KRtc1OjWfWfBP++qIhir5IuETJWfPk9BYw0ygsoOw==',key_name='tempest-TestStampPattern-1893093837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6594c28fbe004babb03de341f082b858',ramdisk_id='',reservation_id='r-4s30shzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1035046562',owner_user_name='tempest-TestStampPattern-1035046562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:49:47Z,user_data=None,user_id='e5ed29e7a68045d1bf0b98f416adcb2f',uuid=91ef1049-cfc1-4ff7-bc79-f17897c49de1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converting VIF {"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=55871f74-ac4f-4e6f-86cb-5f593dd8de7d,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55871f74-ac') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'pci_devices' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:49:49 user nova-compute[82184]:   <uuid>91ef1049-cfc1-4ff7-bc79-f17897c49de1</uuid>
Apr 12 02:49:49 user nova-compute[82184]:   <name>instance-0000002e</name>
Apr 12 02:49:49 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:49:49 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:49:49 user nova-compute[82184]:   <metadata>
Apr 12 02:49:49 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:49:49 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:49:49 user nova-compute[82184]:       <nova:name>tempest-TestStampPattern-server-375589421</nova:name>
Apr 12 02:49:49 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:49:49</nova:creationTime>
Apr 12 02:49:49 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:49:49 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:49:49 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:49:49 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:49:49 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:49:49 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:49:49 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:49:49 user nova-compute[82184]:       <nova:owner>
Apr 12 02:49:49 user nova-compute[82184]:         <nova:user uuid="e5ed29e7a68045d1bf0b98f416adcb2f">tempest-TestStampPattern-1035046562-project-member</nova:user>
Apr 12 02:49:49 user nova-compute[82184]:         <nova:project uuid="6594c28fbe004babb03de341f082b858">tempest-TestStampPattern-1035046562</nova:project>
Apr 12 02:49:49 user nova-compute[82184]:       </nova:owner>
Apr 12 02:49:49 user nova-compute[82184]:       <nova:root type="image" uuid="16f93c82-82f4-4843-b632-b6b6fe0b6c16"/>
Apr 12 02:49:49 user nova-compute[82184]:       <nova:ports>
Apr 12 02:49:49 user nova-compute[82184]:         <nova:port uuid="55871f74-ac4f-4e6f-86cb-5f593dd8de7d">
Apr 12 02:49:49 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 02:49:49 user nova-compute[82184]:         </nova:port>
Apr 12 02:49:49 user nova-compute[82184]:       </nova:ports>
Apr 12 02:49:49 user nova-compute[82184]:     </nova:instance>
Apr 12 02:49:49 user nova-compute[82184]:   </metadata>
Apr 12 02:49:49 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:49:49 user nova-compute[82184]:     <system>
Apr 12 02:49:49 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:49:49 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:49:49 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:49:49 user nova-compute[82184]:       <entry name="serial">91ef1049-cfc1-4ff7-bc79-f17897c49de1</entry>
Apr 12 02:49:49 user nova-compute[82184]:       <entry name="uuid">91ef1049-cfc1-4ff7-bc79-f17897c49de1</entry>
Apr 12 02:49:49 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:49:49 user nova-compute[82184]:     </system>
Apr 12 02:49:49 user nova-compute[82184]:   </sysinfo>
Apr 12 02:49:49 user nova-compute[82184]:   <os>
Apr 12 02:49:49 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:49:49 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:49:49 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:49:49 user nova-compute[82184]:   </os>
Apr 12 02:49:49 user nova-compute[82184]:   <features>
Apr 12 02:49:49 user nova-compute[82184]:     <acpi/>
Apr 12 02:49:49 user nova-compute[82184]:     <apic/>
Apr 12 02:49:49 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:49:49 user nova-compute[82184]:   </features>
Apr 12 02:49:49 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:49:49 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:49:49 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:49:49 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:49:49 user nova-compute[82184]:   </clock>
Apr 12 02:49:49 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:49:49 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:49:49 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:49:49 user nova-compute[82184]:   </cpu>
Apr 12 02:49:49 user nova-compute[82184]:   <devices>
Apr 12 02:49:49 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:49:49 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:49:49 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk"/>
Apr 12 02:49:49 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:49:49 user nova-compute[82184]:     </disk>
Apr 12 02:49:49 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:49:49 user nova-compute[82184]:       <mac address="fa:16:3e:7c:55:4c"/>
Apr 12 02:49:49 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:49:49 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:49:49 user nova-compute[82184]:       <target dev="tap55871f74-ac"/>
Apr 12 02:49:49 user nova-compute[82184]:     </interface>
Apr 12 02:49:49 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:49:49 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/console.log" append="off"/>
Apr 12 02:49:49 user nova-compute[82184]:     </serial>
Apr 12 02:49:49 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:49:49 user nova-compute[82184]:     <video>
Apr 12 02:49:49 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:49:49 user nova-compute[82184]:     </video>
Apr 12 02:49:49 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:49:49 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:49:49 user nova-compute[82184]:     </rng>
Apr 12 02:49:49 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:49:49 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:49:49 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:49:49 user nova-compute[82184]:     </memballoon>
Apr 12 02:49:49 user nova-compute[82184]:   </devices>
Apr 12 02:49:49 user nova-compute[82184]: </domain>
Apr 12 02:49:49 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-375589421',display_name='tempest-TestStampPattern-server-375589421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-375589421',id=46,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpyzmcRX9rlNwf8L3npzKG+KhZsGBYg2FMRQESss2fLWTR7mB/j7XujY+I5ifJXOZVNKSQj7zwTGJjBzU1DUaSm2KRtc1OjWfWfBP++qIhir5IuETJWfPk9BYw0ygsoOw==',key_name='tempest-TestStampPattern-1893093837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6594c28fbe004babb03de341f082b858',ramdisk_id='',reservation_id='r-4s30shzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1035046562',owner_user_name='tempest-TestStampPattern-1035046562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:49:47Z,user_data=None,user_id='e5ed29e7a68045d1bf0b98f416adcb2f',uuid=91ef1049-cfc1-4ff7-bc79-f17897c49de1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converting VIF {"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=55871f74-ac4f-4e6f-86cb-5f593dd8de7d,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55871f74-ac') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG os_vif [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=55871f74-ac4f-4e6f-86cb-5f593dd8de7d,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55871f74-ac') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55871f74-ac, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55871f74-ac, col_values=(('external_ids', {'iface-id': '55871f74-ac4f-4e6f-86cb-5f593dd8de7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:55:4c', 'vm-uuid': '91ef1049-cfc1-4ff7-bc79-f17897c49de1'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:49 user nova-compute[82184]: INFO os_vif [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=55871f74-ac4f-4e6f-86cb-5f593dd8de7d,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55871f74-ac')
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] No VIF found with MAC fa:16:3e:7c:55:4c, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-97edf491-15c8-4626-afaa-8114bb406bdb req-f39bf3de-f288-48bb-9c7a-a62002d24e00 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updated VIF entry in instance network info cache for port 55871f74-ac4f-4e6f-86cb-5f593dd8de7d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-97edf491-15c8-4626-afaa-8114bb406bdb req-f39bf3de-f288-48bb-9c7a-a62002d24e00 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating instance_info_cache with network_info: [{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-97edf491-15c8-4626-afaa-8114bb406bdb req-f39bf3de-f288-48bb-9c7a-a62002d24e00 service nova] Releasing lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:49:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:49:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:50 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-c6288d17-1d2e-4e18-b61e-1c05fed9713a req-bd8d0588-1ef7-49c2-9606-3fd9a29c0dcb service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received event network-vif-plugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6288d17-1d2e-4e18-b61e-1c05fed9713a req-bd8d0588-1ef7-49c2-9606-3fd9a29c0dcb service nova] Acquiring lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6288d17-1d2e-4e18-b61e-1c05fed9713a req-bd8d0588-1ef7-49c2-9606-3fd9a29c0dcb service nova] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:49:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c6288d17-1d2e-4e18-b61e-1c05fed9713a req-bd8d0588-1ef7-49c2-9606-3fd9a29c0dcb service nova] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:49:50 user nova-compute[82184]: DEBUG nova.compute.manager [req-c6288d17-1d2e-4e18-b61e-1c05fed9713a req-bd8d0588-1ef7-49c2-9606-3fd9a29c0dcb service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] No waiting events found dispatching network-vif-plugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:49:50 user nova-compute[82184]: WARNING nova.compute.manager [req-c6288d17-1d2e-4e18-b61e-1c05fed9713a req-bd8d0588-1ef7-49c2-9606-3fd9a29c0dcb service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received unexpected event network-vif-plugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d for instance with vm_state building and task_state spawning.
Apr 12 02:49:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681267792.7435265, 91ef1049-cfc1-4ff7-bc79-f17897c49de1 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:49:52 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] VM Resumed (Lifecycle Event)
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:49:52 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Instance spawned successfully.
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Found default for hw_cdrom_bus of ide {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Found default for hw_disk_bus of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Found default for hw_video_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Found default for hw_vif_model of virtio {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:49:52 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681267792.7448182, 91ef1049-cfc1-4ff7-bc79-f17897c49de1 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:49:52 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] VM Started (Lifecycle Event)
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:49:52 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:49:52 user nova-compute[82184]: INFO nova.compute.manager [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 12 02:49:52 user nova-compute[82184]: DEBUG nova.compute.manager [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:49:52 user nova-compute[82184]: INFO nova.compute.manager [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Took 5.85 seconds to build instance.
Apr 12 02:49:52 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-b9a7fd6a-32be-4292-a956-1899a20f70b2 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.942s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:49:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e53744e-82eb-47e9-b90b-1c17398c32e3 req-9cba109f-9fc5-4ce9-8f61-f7a6cc05117e service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received event network-vif-plugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e53744e-82eb-47e9-b90b-1c17398c32e3 req-9cba109f-9fc5-4ce9-8f61-f7a6cc05117e service nova] Acquiring lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e53744e-82eb-47e9-b90b-1c17398c32e3 req-9cba109f-9fc5-4ce9-8f61-f7a6cc05117e service nova] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:49:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-8e53744e-82eb-47e9-b90b-1c17398c32e3 req-9cba109f-9fc5-4ce9-8f61-f7a6cc05117e service nova] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:49:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-8e53744e-82eb-47e9-b90b-1c17398c32e3 req-9cba109f-9fc5-4ce9-8f61-f7a6cc05117e service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] No waiting events found dispatching network-vif-plugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:49:53 user nova-compute[82184]: WARNING nova.compute.manager [req-8e53744e-82eb-47e9-b90b-1c17398c32e3 req-9cba109f-9fc5-4ce9-8f61-f7a6cc05117e service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received unexpected event network-vif-plugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d for instance with vm_state active and task_state None.
Apr 12 02:49:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:49:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:49:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:50:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:50:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:50:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:50:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:50:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:50:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:50:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:50:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:50:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:50:30 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:50:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:50:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:50:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:50:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:50:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:50:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:50:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:50:37 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:50:37 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:50:37 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:50:38 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:50:38 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:50:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8810MB free_disk=26.19597625732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:50:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:50:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:40 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:50:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:50:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:50:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:50:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:50:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:50:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:50:47 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:50:47 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:50:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating instance_info_cache with network_info: [{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:50:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:50:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:50:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:50:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:50:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:50:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:50:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:50:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:50:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:50:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:50:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:50:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:50:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:51:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:51:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:51:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:51:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:51:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:51:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:51:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:51:31 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:51:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:51:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:51:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:51:37 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-7bd99579-3b2b-4f04-8af5-e5422899073f req-719cde01-76bc-4081-a4e1-bf611be8d50a service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received event network-changed-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-7bd99579-3b2b-4f04-8af5-e5422899073f req-719cde01-76bc-4081-a4e1-bf611be8d50a service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Refreshing instance network info cache due to event network-changed-55871f74-ac4f-4e6f-86cb-5f593dd8de7d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7bd99579-3b2b-4f04-8af5-e5422899073f req-719cde01-76bc-4081-a4e1-bf611be8d50a service nova] Acquiring lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7bd99579-3b2b-4f04-8af5-e5422899073f req-719cde01-76bc-4081-a4e1-bf611be8d50a service nova] Acquired lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG nova.network.neutron [req-7bd99579-3b2b-4f04-8af5-e5422899073f req-719cde01-76bc-4081-a4e1-bf611be8d50a service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Refreshing network info cache for port 55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG nova.objects.instance [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'flavor' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:51:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:51:38 user nova-compute[82184]: INFO nova.compute.manager [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Attaching volume 029c2071-8738-4e0c-84be-af996dcbe9f4 to /dev/vdb
Apr 12 02:51:39 user nova-compute[82184]: DEBUG nova.network.neutron [req-7bd99579-3b2b-4f04-8af5-e5422899073f req-719cde01-76bc-4081-a4e1-bf611be8d50a service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updated VIF entry in instance network info cache for port 55871f74-ac4f-4e6f-86cb-5f593dd8de7d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG nova.network.neutron [req-7bd99579-3b2b-4f04-8af5-e5422899073f req-719cde01-76bc-4081-a4e1-bf611be8d50a service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating instance_info_cache with network_info: [{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG os_brick.utils [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7bd99579-3b2b-4f04-8af5-e5422899073f req-719cde01-76bc-4081-a4e1-bf611be8d50a service nova] Releasing lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd098b4-00ae-48b1-9d78-177579ee52a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2760427-7ea0-49da-ba12-4bb7b8e40b14]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a012e2-c080-475f-a7d7-ec883d6b4592]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86f8070-d7e3-4a99-a027-00889b969246]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:51:39 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0270565-72ed-43cc-8a67-01d761a86f33]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG os_brick.utils [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating existing volume attachment record: 8d306598-d092-4682-8067-33e472671496 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:51:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:40 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:51:40 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:51:40 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=26.195228576660156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:51:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:51:41 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:51:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaqtDdgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:51:43 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:51:43 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:51:43 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[937103e3-a036-478e-95ef-67087c979457]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:51:43 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8c2a71-6419-4c6a-89c2-c7c155b0b6bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4] added
Apr 12 02:51:43 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dbaca0-5122-4ca5-b3fb-0d6121d7bd48]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d563a6-8b79-4bae-830d-583320b7457f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaqtDdgB {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaqtDdgB" returned: 0 in 0.024s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d582b1-2c56-4f28-8344-acf075de0317]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XaqtDdgB'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d122e766-8330-44c5-bdb3-73fec38669a7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94afff9-5e01-4c7f-a35c-976735805a16]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 02:51:43 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 02:51:43 user nova-compute[82184]:  {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:51:43 user nova-compute[82184]: WARNING os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 02:51:43 user nova-compute[82184]: 
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[0214d4bc-ae5b-448d-8592-d209247e5b9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4, portal: 172.16.0.220,3260]
Apr 12 02:51:43 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4, portal: 172.16.0.220,3260] successful.
Apr 12 02:51:43 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dbcbd7-50a6-4432-bc86-7de9403bce32]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07979d7-f397-44e8-aa35-1943d281135f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 (non-flash)
Apr 12 02:51:43 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 (non-flash)
Apr 12 02:51:43 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a34458-d0c3-4cc9-9dfe-da16af491004]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:43 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:51:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:44 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:51:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaqtDdgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:51:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:51:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23166636533653730', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:51:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166636533653730', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:51:44 user nova-compute[82184]: DEBUG nova.objects.instance [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'flavor' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:51:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:51:44 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:51:44 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:51:44 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:51:44 user nova-compute[82184]:   <serial>029c2071-8738-4e0c-84be-af996dcbe9f4</serial>
Apr 12 02:51:44 user nova-compute[82184]: </disk>
Apr 12 02:51:44 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:51:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:51:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:51:45 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] No VIF found with MAC fa:16:3e:7c:55:4c, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:51:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-dd3cd18e-80c6-44e8-bb73-f3fb1c9002b8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.218s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:51:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:51:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:51:46 user nova-compute[82184]: INFO nova.compute.manager [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Detaching volume 029c2071-8738-4e0c-84be-af996dcbe9f4
Apr 12 02:51:46 user nova-compute[82184]: INFO nova.virt.block_device [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Attempting to driver detach volume 029c2071-8738-4e0c-84be-af996dcbe9f4 from mountpoint /dev/vdb
Apr 12 02:51:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Attempting to detach device vdb from instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:51:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:51:46 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:51:46 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:51:46 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:51:46 user nova-compute[82184]:   <serial>029c2071-8738-4e0c-84be-af996dcbe9f4</serial>
Apr 12 02:51:46 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:51:46 user nova-compute[82184]: </disk>
Apr 12 02:51:46 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:51:46 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Successfully detached device vdb from instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 from the persistent domain config.
Apr 12 02:51:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:51:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:51:46 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:51:46 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:51:46 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:51:46 user nova-compute[82184]:   <serial>029c2071-8738-4e0c-84be-af996dcbe9f4</serial>
Apr 12 02:51:46 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:51:46 user nova-compute[82184]: </disk>
Apr 12 02:51:46 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681267907.1236212, 91ef1049-cfc1-4ff7-bc79-f17897c49de1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:51:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Successfully detached device vdb from instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 from the live domain config.
Apr 12 02:51:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaqtDdgB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:51:47 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f856b33f-0be6-4142-93ab-66b363ded3e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:51:47 user nova-compute[82184]: No targets found.
Apr 12 02:51:47 user nova-compute[82184]: iSNS:
Apr 12 02:51:47 user nova-compute[82184]: No targets found.
Apr 12 02:51:47 user nova-compute[82184]: STATIC:
Apr 12 02:51:47 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4
Apr 12 02:51:47 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:51:47 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:51:47 user nova-compute[82184]: FIRMWARE:
Apr 12 02:51:47 user nova-compute[82184]: No targets found.
Apr 12 02:51:47 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:51:47 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:51:47 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a02f25e-5f91-4748-8035-fbe113e644f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c8cf41-cdac-41bc-a59a-5cc9b9673378]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 (non-flash)
Apr 12 02:51:47 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 (non-flash)
Apr 12 02:51:47 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26b74396c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[64404e5e-4cec-46d3-aca5-44985a8f5c00]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd8e822-7b2f-47a8-b4b0-edf8cebc5858]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eeb957-1aa5-4c2f-a5b7-54b140710a2d]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0b939a-5aae-443b-baa5-6ec59fbd9607]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[5207aee7-d701-47a7-a39b-7724821d0fcb]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65d570d-b4ff-4717-938f-c7c337c12589]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4, portal: 172.16.0.220,3260]
Apr 12 02:51:47 user nova-compute[82184]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4, portal: 172.16.0.220,3260] successful.
Apr 12 02:51:47 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:029c2071-8738-4e0c-84be-af996dcbe9f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf02d79-c788-4771-add0-a94315d5d39a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] <== disconnect_volume: return (280ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:51:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:48 user nova-compute[82184]: DEBUG nova.objects.instance [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'flavor' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0dc2728d-82d1-44d8-ac83-fa70f7ce3ea7 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.617s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:51:48 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:51:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:51:48 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:51:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:51:48 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:51:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating instance_info_cache with network_info: [{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:51:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:51:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:51:50 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:51:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:51:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:51:57 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:51:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:52:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:12 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:12 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:52:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:52:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:29 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:32 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:52:34 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG nova.compute.manager [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:52:39 user nova-compute[82184]: INFO nova.compute.manager [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] instance snapshotting
Apr 12 02:52:39 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Beginning live snapshot process
Apr 12 02:52:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json -f qcow2 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json -f qcow2 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json -f qcow2" returned: 0 in 0.150s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690 --force-share --output=json" returned: 0 in 0.129s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzs20j2sw/de9cc61017b94bd09493f14b64df5bae.delta 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95f71f969739e39e07ee6197f212e1b4213ce690,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzs20j2sw/de9cc61017b94bd09493f14b64df5bae.delta 1073741824" returned: 0 in 0.067s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:39 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 02:52:40 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 02:52:41 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=82184) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 02:52:41 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 02:52:41 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzs20j2sw/de9cc61017b94bd09493f14b64df5bae.delta /opt/stack/data/nova/instances/snapshots/tmpzs20j2sw/de9cc61017b94bd09493f14b64df5bae {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzs20j2sw/de9cc61017b94bd09493f14b64df5bae.delta /opt/stack/data/nova/instances/snapshots/tmpzs20j2sw/de9cc61017b94bd09493f14b64df5bae" returned: 0 in 0.453s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:41 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Snapshot extracted, beginning image upload
Apr 12 02:52:41 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:52:41 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:52:41 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:42 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:52:42 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=26.15821075439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:52:42 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:52:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:43 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Snapshot image upload complete
Apr 12 02:52:43 user nova-compute[82184]: INFO nova.compute.manager [None req-84c8536e-31aa-40f6-a900-bf029f372d63 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Took 4.77 seconds to snapshot the instance on the hypervisor.
Apr 12 02:52:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:52:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Starting instance... {{(pid=82184) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82184) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 02:52:47 user nova-compute[82184]: INFO nova.compute.claims [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Claim successful on node user
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Start building networks asynchronously for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Allocating IP information in the background. {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.network.neutron [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] allocate_for_instance() {{(pid=82184) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 02:52:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Start building block device mappings for instance. {{(pid=82184) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.policy [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5ed29e7a68045d1bf0b98f416adcb2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6594c28fbe004babb03de341f082b858', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82184) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.compute.manager [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Start spawning the instance on the hypervisor. {{(pid=82184) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Creating instance directory {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 02:52:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Creating image(s)
Apr 12 02:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "/opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "/opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "/opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "16f06645cdd02107e0a848f5a8528cb152e196bc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:52:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "16f06645cdd02107e0a848f5a8528cb152e196bc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc.part --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:48 user nova-compute[82184]: DEBUG nova.network.neutron [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Successfully created port: 94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 02:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc.part --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:48 user nova-compute[82184]: DEBUG nova.virt.images [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] b0a853d4-2140-47ec-8d81-5ef1133ca1cb was qcow2, converting to raw {{(pid=82184) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 02:52:48 user nova-compute[82184]: DEBUG nova.privsep.utils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82184) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 02:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc.part /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc.converted {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc.part /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc.converted" returned: 0 in 0.407s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc.converted --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "16f06645cdd02107e0a848f5a8528cb152e196bc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.485s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Successfully updated port: 94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-5fc69c8c-51e3-47f1-a385-f63c4805edae req-97e7c4e8-50be-48eb-81b6-09af68d8457b service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received event network-changed-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [req-5fc69c8c-51e3-47f1-a385-f63c4805edae req-97e7c4e8-50be-48eb-81b6-09af68d8457b service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Refreshing instance network info cache due to event network-changed-94b1f9ed-97f2-47b6-a547-86c7bda32221. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5fc69c8c-51e3-47f1-a385-f63c4805edae req-97e7c4e8-50be-48eb-81b6-09af68d8457b service nova] Acquiring lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5fc69c8c-51e3-47f1-a385-f63c4805edae req-97e7c4e8-50be-48eb-81b6-09af68d8457b service nova] Acquired lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-5fc69c8c-51e3-47f1-a385-f63c4805edae req-97e7c4e8-50be-48eb-81b6-09af68d8457b service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Refreshing network info cache for port 94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-5fc69c8c-51e3-47f1-a385-f63c4805edae req-97e7c4e8-50be-48eb-81b6-09af68d8457b service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc --force-share --output=json" returned: 0 in 0.139s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "16f06645cdd02107e0a848f5a8528cb152e196bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "16f06645cdd02107e0a848f5a8528cb152e196bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc --force-share --output=json" returned: 0 in 0.133s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc,backing_fmt=raw /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk 1073741824 {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.neutron [req-5fc69c8c-51e3-47f1-a385-f63c4805edae req-97e7c4e8-50be-48eb-81b6-09af68d8457b service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc,backing_fmt=raw /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk 1073741824" returned: 0 in 0.052s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "16f06645cdd02107e0a848f5a8528cb152e196bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-5fc69c8c-51e3-47f1-a385-f63c4805edae req-97e7c4e8-50be-48eb-81b6-09af68d8457b service nova] Releasing lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquired lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Building network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Instance cache missing network info. {{(pid=82184) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/16f06645cdd02107e0a848f5a8528cb152e196bc --force-share --output=json" returned: 0 in 0.137s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'migration_context' on Instance uuid c19065ba-2de8-4aa3-ba51-458dc5dd18b0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Created local disks {{(pid=82184) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Ensure instance console log exists: /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/console.log {{(pid=82184) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Updating instance_info_cache with network_info: [{"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Skipping network cache update for instance because it is Building. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Releasing lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.compute.manager [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Instance network_info: |[{"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82184) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Start _get_guest_xml network_info=[{"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7c355f09fa497ae6357a9075af346837',container_format='bare',created_at=2023-04-12T02:52:39Z,direct_url=<?>,disk_format='qcow2',id=b0a853d4-2140-47ec-8d81-5ef1133ca1cb,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-752374696',owner='6594c28fbe004babb03de341f082b858',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T02:52:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'device_type': 'disk', 'image_id': 'b0a853d4-2140-47ec-8d81-5ef1133ca1cb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 02:52:49 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:52:49 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82184) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T01:47:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7c355f09fa497ae6357a9075af346837',container_format='bare',created_at=2023-04-12T02:52:39Z,direct_url=<?>,disk_format='qcow2',id=b0a853d4-2140-47ec-8d81-5ef1133ca1cb,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-752374696',owner='6594c28fbe004babb03de341f082b858',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T02:52:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Flavor limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Image limits 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Flavor pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Image pref 0:0:0 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82184) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Got 1 possible topologies {{(pid=82184) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.hardware [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82184) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-56434730',display_name='tempest-TestStampPattern-server-56434730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-56434730',id=47,image_ref='b0a853d4-2140-47ec-8d81-5ef1133ca1cb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpyzmcRX9rlNwf8L3npzKG+KhZsGBYg2FMRQESss2fLWTR7mB/j7XujY+I5ifJXOZVNKSQj7zwTGJjBzU1DUaSm2KRtc1OjWfWfBP++qIhir5IuETJWfPk9BYw0ygsoOw==',key_name='tempest-TestStampPattern-1893093837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6594c28fbe004babb03de341f082b858',ramdisk_id='',reservation_id='r-0agzhawv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='91ef1049-cfc1-4ff7-bc79-f17897c49de1',image_min_disk='1',image_min_ram='0',image_owner_id='6594c28fbe004babb03de341f082b858',image_owner_project_name='tempest-TestStampPattern-1035046562',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1035046562-project-member',image_user_id='e5ed29e7a68045d1bf0b98f416adcb2f',network_allocated='True',owner_project_name='tempest-TestStampPattern-1035046562',owner_user_name='tempest-TestStampPattern-1035046562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:52:48Z,user_data=None,user_id='e5ed29e7a68045d1bf0b98f416adcb2f',uuid=c19065ba-2de8-4aa3-ba51-458dc5dd18b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82184) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converting VIF {"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4f:0c,bridge_name='br-int',has_traffic_filtering=True,id=94b1f9ed-97f2-47b6-a547-86c7bda32221,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b1f9ed-97') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'pci_devices' on Instance uuid c19065ba-2de8-4aa3-ba51-458dc5dd18b0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 02:52:49 user nova-compute[82184]:   <uuid>c19065ba-2de8-4aa3-ba51-458dc5dd18b0</uuid>
Apr 12 02:52:49 user nova-compute[82184]:   <name>instance-0000002f</name>
Apr 12 02:52:49 user nova-compute[82184]:   <memory>131072</memory>
Apr 12 02:52:49 user nova-compute[82184]:   <vcpu>1</vcpu>
Apr 12 02:52:49 user nova-compute[82184]:   <metadata>
Apr 12 02:52:49 user nova-compute[82184]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 02:52:49 user nova-compute[82184]:       <nova:package version="0.0.0"/>
Apr 12 02:52:49 user nova-compute[82184]:       <nova:name>tempest-TestStampPattern-server-56434730</nova:name>
Apr 12 02:52:49 user nova-compute[82184]:       <nova:creationTime>2023-04-12 02:52:49</nova:creationTime>
Apr 12 02:52:49 user nova-compute[82184]:       <nova:flavor name="m1.nano">
Apr 12 02:52:49 user nova-compute[82184]:         <nova:memory>128</nova:memory>
Apr 12 02:52:49 user nova-compute[82184]:         <nova:disk>1</nova:disk>
Apr 12 02:52:49 user nova-compute[82184]:         <nova:swap>0</nova:swap>
Apr 12 02:52:49 user nova-compute[82184]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 02:52:49 user nova-compute[82184]:         <nova:vcpus>1</nova:vcpus>
Apr 12 02:52:49 user nova-compute[82184]:       </nova:flavor>
Apr 12 02:52:49 user nova-compute[82184]:       <nova:owner>
Apr 12 02:52:49 user nova-compute[82184]:         <nova:user uuid="e5ed29e7a68045d1bf0b98f416adcb2f">tempest-TestStampPattern-1035046562-project-member</nova:user>
Apr 12 02:52:49 user nova-compute[82184]:         <nova:project uuid="6594c28fbe004babb03de341f082b858">tempest-TestStampPattern-1035046562</nova:project>
Apr 12 02:52:49 user nova-compute[82184]:       </nova:owner>
Apr 12 02:52:49 user nova-compute[82184]:       <nova:root type="image" uuid="b0a853d4-2140-47ec-8d81-5ef1133ca1cb"/>
Apr 12 02:52:49 user nova-compute[82184]:       <nova:ports>
Apr 12 02:52:49 user nova-compute[82184]:         <nova:port uuid="94b1f9ed-97f2-47b6-a547-86c7bda32221">
Apr 12 02:52:49 user nova-compute[82184]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 02:52:49 user nova-compute[82184]:         </nova:port>
Apr 12 02:52:49 user nova-compute[82184]:       </nova:ports>
Apr 12 02:52:49 user nova-compute[82184]:     </nova:instance>
Apr 12 02:52:49 user nova-compute[82184]:   </metadata>
Apr 12 02:52:49 user nova-compute[82184]:   <sysinfo type="smbios">
Apr 12 02:52:49 user nova-compute[82184]:     <system>
Apr 12 02:52:49 user nova-compute[82184]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 02:52:49 user nova-compute[82184]:       <entry name="product">OpenStack Nova</entry>
Apr 12 02:52:49 user nova-compute[82184]:       <entry name="version">0.0.0</entry>
Apr 12 02:52:49 user nova-compute[82184]:       <entry name="serial">c19065ba-2de8-4aa3-ba51-458dc5dd18b0</entry>
Apr 12 02:52:49 user nova-compute[82184]:       <entry name="uuid">c19065ba-2de8-4aa3-ba51-458dc5dd18b0</entry>
Apr 12 02:52:49 user nova-compute[82184]:       <entry name="family">Virtual Machine</entry>
Apr 12 02:52:49 user nova-compute[82184]:     </system>
Apr 12 02:52:49 user nova-compute[82184]:   </sysinfo>
Apr 12 02:52:49 user nova-compute[82184]:   <os>
Apr 12 02:52:49 user nova-compute[82184]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 02:52:49 user nova-compute[82184]:     <boot dev="hd"/>
Apr 12 02:52:49 user nova-compute[82184]:     <smbios mode="sysinfo"/>
Apr 12 02:52:49 user nova-compute[82184]:   </os>
Apr 12 02:52:49 user nova-compute[82184]:   <features>
Apr 12 02:52:49 user nova-compute[82184]:     <acpi/>
Apr 12 02:52:49 user nova-compute[82184]:     <apic/>
Apr 12 02:52:49 user nova-compute[82184]:     <vmcoreinfo/>
Apr 12 02:52:49 user nova-compute[82184]:   </features>
Apr 12 02:52:49 user nova-compute[82184]:   <clock offset="utc">
Apr 12 02:52:49 user nova-compute[82184]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 02:52:49 user nova-compute[82184]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 02:52:49 user nova-compute[82184]:     <timer name="hpet" present="no"/>
Apr 12 02:52:49 user nova-compute[82184]:   </clock>
Apr 12 02:52:49 user nova-compute[82184]:   <cpu mode="custom" match="exact">
Apr 12 02:52:49 user nova-compute[82184]:     <model>Nehalem</model>
Apr 12 02:52:49 user nova-compute[82184]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 02:52:49 user nova-compute[82184]:   </cpu>
Apr 12 02:52:49 user nova-compute[82184]:   <devices>
Apr 12 02:52:49 user nova-compute[82184]:     <disk type="file" device="disk">
Apr 12 02:52:49 user nova-compute[82184]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 02:52:49 user nova-compute[82184]:       <source file="/opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk"/>
Apr 12 02:52:49 user nova-compute[82184]:       <target dev="vda" bus="virtio"/>
Apr 12 02:52:49 user nova-compute[82184]:     </disk>
Apr 12 02:52:49 user nova-compute[82184]:     <interface type="ethernet">
Apr 12 02:52:49 user nova-compute[82184]:       <mac address="fa:16:3e:86:4f:0c"/>
Apr 12 02:52:49 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:52:49 user nova-compute[82184]:       <mtu size="1442"/>
Apr 12 02:52:49 user nova-compute[82184]:       <target dev="tap94b1f9ed-97"/>
Apr 12 02:52:49 user nova-compute[82184]:     </interface>
Apr 12 02:52:49 user nova-compute[82184]:     <serial type="pty">
Apr 12 02:52:49 user nova-compute[82184]:       <log file="/opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/console.log" append="off"/>
Apr 12 02:52:49 user nova-compute[82184]:     </serial>
Apr 12 02:52:49 user nova-compute[82184]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 02:52:49 user nova-compute[82184]:     <video>
Apr 12 02:52:49 user nova-compute[82184]:       <model type="virtio"/>
Apr 12 02:52:49 user nova-compute[82184]:     </video>
Apr 12 02:52:49 user nova-compute[82184]:     <rng model="virtio">
Apr 12 02:52:49 user nova-compute[82184]:       <backend model="random">/dev/urandom</backend>
Apr 12 02:52:49 user nova-compute[82184]:     </rng>
Apr 12 02:52:49 user nova-compute[82184]:     <controller type="usb" index="0" model="none"/>
Apr 12 02:52:49 user nova-compute[82184]:     <memballoon model="virtio">
Apr 12 02:52:49 user nova-compute[82184]:       <stats period="10"/>
Apr 12 02:52:49 user nova-compute[82184]:     </memballoon>
Apr 12 02:52:49 user nova-compute[82184]:   </devices>
Apr 12 02:52:49 user nova-compute[82184]: </domain>
Apr 12 02:52:49 user nova-compute[82184]:  {{(pid=82184) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-56434730',display_name='tempest-TestStampPattern-server-56434730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-56434730',id=47,image_ref='b0a853d4-2140-47ec-8d81-5ef1133ca1cb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpyzmcRX9rlNwf8L3npzKG+KhZsGBYg2FMRQESss2fLWTR7mB/j7XujY+I5ifJXOZVNKSQj7zwTGJjBzU1DUaSm2KRtc1OjWfWfBP++qIhir5IuETJWfPk9BYw0ygsoOw==',key_name='tempest-TestStampPattern-1893093837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6594c28fbe004babb03de341f082b858',ramdisk_id='',reservation_id='r-0agzhawv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='91ef1049-cfc1-4ff7-bc79-f17897c49de1',image_min_disk='1',image_min_ram='0',image_owner_id='6594c28fbe004babb03de341f082b858',image_owner_project_name='tempest-TestStampPattern-1035046562',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1035046562-project-member',image_user_id='e5ed29e7a68045d1bf0b98f416adcb2f',network_allocated='True',owner_project_name='tempest-TestStampPattern-1035046562',owner_user_name='tempest-TestStampPattern-1035046562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T02:52:48Z,user_data=None,user_id='e5ed29e7a68045d1bf0b98f416adcb2f',uuid=c19065ba-2de8-4aa3-ba51-458dc5dd18b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converting VIF {"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4f:0c,bridge_name='br-int',has_traffic_filtering=True,id=94b1f9ed-97f2-47b6-a547-86c7bda32221,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b1f9ed-97') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG os_vif [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4f:0c,bridge_name='br-int',has_traffic_filtering=True,id=94b1f9ed-97f2-47b6-a547-86c7bda32221,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b1f9ed-97') {{(pid=82184) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94b1f9ed-97, may_exist=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94b1f9ed-97, col_values=(('external_ids', {'iface-id': '94b1f9ed-97f2-47b6-a547-86c7bda32221', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:4f:0c', 'vm-uuid': 'c19065ba-2de8-4aa3-ba51-458dc5dd18b0'}),)) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:49 user nova-compute[82184]: INFO os_vif [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4f:0c,bridge_name='br-int',has_traffic_filtering=True,id=94b1f9ed-97f2-47b6-a547-86c7bda32221,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b1f9ed-97')
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:52:49 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] No VIF found with MAC fa:16:3e:86:4f:0c, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:52:50 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating instance_info_cache with network_info: [{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:52:50 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:52:50 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-d92ac27d-c98e-4c5b-8d87-b2bd7db7812b req-3ca97e15-fb69-416c-a930-936b37cf5f69 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received event network-vif-plugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d92ac27d-c98e-4c5b-8d87-b2bd7db7812b req-3ca97e15-fb69-416c-a930-936b37cf5f69 service nova] Acquiring lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d92ac27d-c98e-4c5b-8d87-b2bd7db7812b req-3ca97e15-fb69-416c-a930-936b37cf5f69 service nova] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-d92ac27d-c98e-4c5b-8d87-b2bd7db7812b req-3ca97e15-fb69-416c-a930-936b37cf5f69 service nova] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG nova.compute.manager [req-d92ac27d-c98e-4c5b-8d87-b2bd7db7812b req-3ca97e15-fb69-416c-a930-936b37cf5f69 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] No waiting events found dispatching network-vif-plugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:52:51 user nova-compute[82184]: WARNING nova.compute.manager [req-d92ac27d-c98e-4c5b-8d87-b2bd7db7812b req-3ca97e15-fb69-416c-a930-936b37cf5f69 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received unexpected event network-vif-plugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 for instance with vm_state building and task_state spawning.
Apr 12 02:52:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:51 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:52:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:52 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681267973.3471732, c19065ba-2de8-4aa3-ba51-458dc5dd18b0 => Resumed> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:52:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] VM Resumed (Lifecycle Event)
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Instance event wait completed in 0 seconds for  {{(pid=82184) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Guest created on hypervisor {{(pid=82184) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 02:52:53 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Instance spawned successfully.
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Found default for hw_input_bus of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Found default for hw_pointer_model of None {{(pid=82184) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:52:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.virt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Emitting event <LifecycleEvent: 1681267973.3486862, c19065ba-2de8-4aa3-ba51-458dc5dd18b0 => Started> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:52:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] VM Started (Lifecycle Event)
Apr 12 02:52:53 user nova-compute[82184]: INFO nova.compute.manager [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Took 5.86 seconds to spawn the instance on the hypervisor.
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82184) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-7be9eefc-5720-4a39-958e-d40c8f936cda req-92abd0a0-0a6c-4ad3-9a15-b836310b609c service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received event network-vif-plugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7be9eefc-5720-4a39-958e-d40c8f936cda req-92abd0a0-0a6c-4ad3-9a15-b836310b609c service nova] Acquiring lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7be9eefc-5720-4a39-958e-d40c8f936cda req-92abd0a0-0a6c-4ad3-9a15-b836310b609c service nova] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-7be9eefc-5720-4a39-958e-d40c8f936cda req-92abd0a0-0a6c-4ad3-9a15-b836310b609c service nova] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:52:53 user nova-compute[82184]: DEBUG nova.compute.manager [req-7be9eefc-5720-4a39-958e-d40c8f936cda req-92abd0a0-0a6c-4ad3-9a15-b836310b609c service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] No waiting events found dispatching network-vif-plugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:52:53 user nova-compute[82184]: WARNING nova.compute.manager [req-7be9eefc-5720-4a39-958e-d40c8f936cda req-92abd0a0-0a6c-4ad3-9a15-b836310b609c service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received unexpected event network-vif-plugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 for instance with vm_state building and task_state spawning.
Apr 12 02:52:53 user nova-compute[82184]: INFO nova.compute.manager [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 02:52:53 user nova-compute[82184]: INFO nova.compute.manager [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Took 6.45 seconds to build instance.
Apr 12 02:52:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-3a602caf-ffd0-4e11-bc6f-df16426bd475 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.550s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:52:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:52:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:52:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:52:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:52:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:52:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:52:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:53:07 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:53:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:53:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:53:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:53:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:22 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:53:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:33 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:53:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:53:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:53:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:39 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:53:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:41 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:53:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:53:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:53:43 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:53:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:53:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:44 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:53:44 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:53:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8718MB free_disk=26.086448669433594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:53:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:53:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:53:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c19065ba-2de8-4aa3-ba51-458dc5dd18b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:53:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:53:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:53:45 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:53:45 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:53:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:53:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:53:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:53:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:53:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:53:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:53:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:53:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating instance_info_cache with network_info: [{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:53:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:53:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:53:59 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:53:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:02 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:54:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:54:33 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:54:34 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:54:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:54:37 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-c23d1c64-510d-4f97-abca-449d23fa1e8f req-0f788a0f-c7a2-4cc5-9b2c-7777b79d6a37 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received event network-changed-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:54:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-c23d1c64-510d-4f97-abca-449d23fa1e8f req-0f788a0f-c7a2-4cc5-9b2c-7777b79d6a37 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Refreshing instance network info cache due to event network-changed-94b1f9ed-97f2-47b6-a547-86c7bda32221. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:54:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c23d1c64-510d-4f97-abca-449d23fa1e8f req-0f788a0f-c7a2-4cc5-9b2c-7777b79d6a37 service nova] Acquiring lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:54:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c23d1c64-510d-4f97-abca-449d23fa1e8f req-0f788a0f-c7a2-4cc5-9b2c-7777b79d6a37 service nova] Acquired lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:54:38 user nova-compute[82184]: DEBUG nova.network.neutron [req-c23d1c64-510d-4f97-abca-449d23fa1e8f req-0f788a0f-c7a2-4cc5-9b2c-7777b79d6a37 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Refreshing network info cache for port 94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:54:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:54:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:54:38 user nova-compute[82184]: DEBUG nova.objects.instance [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'flavor' on Instance uuid c19065ba-2de8-4aa3-ba51-458dc5dd18b0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:54:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG nova.network.neutron [req-c23d1c64-510d-4f97-abca-449d23fa1e8f req-0f788a0f-c7a2-4cc5-9b2c-7777b79d6a37 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Updated VIF entry in instance network info cache for port 94b1f9ed-97f2-47b6-a547-86c7bda32221. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG nova.network.neutron [req-c23d1c64-510d-4f97-abca-449d23fa1e8f req-0f788a0f-c7a2-4cc5-9b2c-7777b79d6a37 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Updating instance_info_cache with network_info: [{"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-c23d1c64-510d-4f97-abca-449d23fa1e8f req-0f788a0f-c7a2-4cc5-9b2c-7777b79d6a37 service nova] Releasing lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:54:39 user nova-compute[82184]: INFO nova.compute.manager [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Attaching volume 7459b83b-dbd5-45c0-8dcc-0696b2768784 to /dev/vdb
Apr 12 02:54:39 user nova-compute[82184]: DEBUG os_brick.utils [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cb81a4-d09a-4d1e-b8c7-81bba4a35c24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:dca7476e6711\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d85eef-cefa-4f3b-afad-11ca524788ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac484cf-7063-4662-9013-a1213735e5d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[6063d703-c750-48e4-9451-d00182303c71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Running cmd (subprocess): nvme version {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] 'nvme version' failed. Not Retrying. {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] nvme not present on system {{(pid=82184) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 02:54:39 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:40 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 02:54:40 user nova-compute[82184]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 02:54:40 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be76619-02ae-43ff-b382-228f032d9565]: (4, '') {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82184) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 02:54:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 02:54:40 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.lightos [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] LIGHTOS: no hostnqn found. {{(pid=82184) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 02:54:40 user nova-compute[82184]: DEBUG os_brick.utils [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:dca7476e6711', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:54:40 user nova-compute[82184]: DEBUG nova.virt.block_device [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Updating existing volume attachment record: 54f6f188-39c7-4ac0-b5b6-2340f0460696 {{(pid=82184) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 02:54:41 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:54:42 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:54:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:54:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:54:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:54:43 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:54:43 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:54:43 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:44 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:54:44 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:54:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8747MB free_disk=26.077850341796875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Calling os-brick to attach iSCSI Volume {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtLjDuBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:54:44 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:54:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:54:44 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:54:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:54:44 user nova-compute[82184]: INFO os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68a97ff-2b0c-43b8-935e-42ad3ba12349]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 02:54:44 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --interface default --op new {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ea373c-4c40-49d6-a713-7425cfb957aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784] added\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784] added
Apr 12 02:54:45 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance c19065ba-2de8-4aa3-ba51-458dc5dd18b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9479544-3c2c-4f44-a841-a183fe2b7e05]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3612be91-93b1-4d34-af05-a33294d0d181]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtLjDuBi {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rtLjDuBi" returned: 0 in 0.030s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8ff864-5736-4a21-aeef-f5eba7abd56f]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rtLjDuBi'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1fbf58-47ac-4be4-96e7-46818a7ff5b7]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d144e3f-79f8-4f55-9cac-be02bf4d523a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 02:54:45 user nova-compute[82184]:  {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 02:54:45 user nova-compute[82184]:  {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:54:45 user nova-compute[82184]: WARNING os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 02:54:45 user nova-compute[82184]: 
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --login {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[8502109a-89c0-4877-9c10-a24ec7a4b8fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784, portal: 172.16.0.220,3260]
Apr 12 02:54:45 user nova-compute[82184]: Login to [iface: default, target: iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784, portal: 172.16.0.220,3260] successful.
Apr 12 02:54:45 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcc32fd-f864-48f4-8773-3920b80e2b33]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e3bd60-7093-492f-9a50-62c0240de66a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 (non-flash)
Apr 12 02:54:45 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 (non-flash)
Apr 12 02:54:45 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Connected to 172.16.0.220:3260 {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=82184) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82184) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68da271-a00b-4209-83a6-cb79a9bc57c4]: (4, ('- - 0', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82184) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 02:54:45 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtLjDuBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82184) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 02:54:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:54:46 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26230633661383839', 'path': '/dev/sdb'} {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:54:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230633661383839', 'path': '/dev/sdb'} {{(pid=82184) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 02:54:46 user nova-compute[82184]: DEBUG nova.objects.instance [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'flavor' on Instance uuid c19065ba-2de8-4aa3-ba51-458dc5dd18b0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:54:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 02:54:46 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:54:46 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:54:46 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:54:46 user nova-compute[82184]:   <serial>7459b83b-dbd5-45c0-8dcc-0696b2768784</serial>
Apr 12 02:54:46 user nova-compute[82184]: </disk>
Apr 12 02:54:46 user nova-compute[82184]:  {{(pid=82184) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 02:54:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] No BDM found with device name vda, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:54:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82184) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 02:54:46 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] No VIF found with MAC fa:16:3e:86:4f:0c, not building metadata {{(pid=82184) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 02:54:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-9cdb56a5-7632-484e-bf38-fb6812186166 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.175s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:54:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:54:47 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:54:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:54:47 user nova-compute[82184]: INFO nova.compute.manager [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Detaching volume 7459b83b-dbd5-45c0-8dcc-0696b2768784
Apr 12 02:54:47 user nova-compute[82184]: INFO nova.virt.block_device [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Attempting to driver detach volume 7459b83b-dbd5-45c0-8dcc-0696b2768784 from mountpoint /dev/vdb
Apr 12 02:54:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Attempting to detach device vdb from instance c19065ba-2de8-4aa3-ba51-458dc5dd18b0 from the persistent domain config. {{(pid=82184) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 02:54:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:54:47 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:54:47 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:54:47 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:54:47 user nova-compute[82184]:   <serial>7459b83b-dbd5-45c0-8dcc-0696b2768784</serial>
Apr 12 02:54:47 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:54:47 user nova-compute[82184]: </disk>
Apr 12 02:54:47 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:54:47 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Successfully detached device vdb from instance c19065ba-2de8-4aa3-ba51-458dc5dd18b0 from the persistent domain config.
Apr 12 02:54:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c19065ba-2de8-4aa3-ba51-458dc5dd18b0 from the live domain config. {{(pid=82184) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 02:54:47 user nova-compute[82184]: DEBUG nova.virt.libvirt.guest [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 02:54:47 user nova-compute[82184]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 02:54:47 user nova-compute[82184]:   <source dev="/dev/sdb"/>
Apr 12 02:54:47 user nova-compute[82184]:   <target dev="vdb" bus="virtio"/>
Apr 12 02:54:47 user nova-compute[82184]:   <serial>7459b83b-dbd5-45c0-8dcc-0696b2768784</serial>
Apr 12 02:54:47 user nova-compute[82184]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 02:54:47 user nova-compute[82184]: </disk>
Apr 12 02:54:47 user nova-compute[82184]:  {{(pid=82184) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-d659ae14-625e-4b9a-845c-8cfb626ef93a None None] Received event <DeviceRemovedEvent: 1681268088.304678, c19065ba-2de8-4aa3-ba51-458dc5dd18b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82184) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.driver [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c19065ba-2de8-4aa3-ba51-458dc5dd18b0 {{(pid=82184) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 02:54:48 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Successfully detached device vdb from instance c19065ba-2de8-4aa3-ba51-458dc5dd18b0 from the live domain config.
Apr 12 02:54:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] calling os-brick to detach iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f26a81f0ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rtLjDuBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 02:54:48 user nova-compute[82184]: WARNING os_brick.initiator.connectors.base [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[26811cde-dce4-49a6-befd-d5b7ec1d79f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 02:54:48 user nova-compute[82184]: No targets found.
Apr 12 02:54:48 user nova-compute[82184]: iSNS:
Apr 12 02:54:48 user nova-compute[82184]: No targets found.
Apr 12 02:54:48 user nova-compute[82184]: STATIC:
Apr 12 02:54:48 user nova-compute[82184]: Target: iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784
Apr 12 02:54:48 user nova-compute[82184]:         Portal: 172.16.0.220:3260,-1
Apr 12 02:54:48 user nova-compute[82184]:                 Iface Name: default
Apr 12 02:54:48 user nova-compute[82184]: FIRMWARE:
Apr 12 02:54:48 user nova-compute[82184]: No targets found.
Apr 12 02:54:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 02:54:48 user nova-compute[82184]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 02:54:48 user nova-compute[82184]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82184) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784', 0)] {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0306d45-220c-4444-b0f5-9f89817dc2c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[98137952-9f13-43b5-9d56-7f2721160a73]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 (non-flash)\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 (non-flash)
Apr 12 02:54:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 (non-flash)
Apr 12 02:54:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f26a85cfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784'): ({'sdb'}, set())}) {{(pid=82184) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Removing single pathed devices sdb {{(pid=82184) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9761edc-5d92-40ac-9e84-de6722fdef22]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f77a11a-5ad4-4c31-98e2-e74aedc66e79]: (4, ('ok\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Flushing IO for device /dev/sdb {{(pid=82184) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b2b6e0-10e4-4601-b6be-b9e250202bce]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82184) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14b79be-7b1e-468b-b140-4f7707d6ae20]: (4, ('1', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.linuxscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] SCSI volumes sdb have been removed. {{(pid=82184) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784')] {{(pid=82184) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fc9101-9399-44d6-a41b-904358137657]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --logout {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[572a6022-fee7-4d98-95b4-df67beee6ec0]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784, portal: 172.16.0.220,3260]
Apr 12 02:54:48 user nova-compute[82184]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784, portal: 172.16.0.220,3260] successful.
Apr 12 02:54:48 user nova-compute[82184]:  stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op delete {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7459b83b-dbd5-45c0-8dcc-0696b2768784 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=92498) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fd6c2d-9abc-48f1-8c66-5aed47cfd85a]: (4, ('', '')) {{(pid=92498) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82184) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.base [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG os_brick.initiator.connectors.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] <== disconnect_volume: return (278ms) None {{(pid=82184) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 02:54:48 user nova-compute[82184]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Disconnected iSCSI Volume {{(pid=82184) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 02:54:49 user nova-compute[82184]: DEBUG nova.objects.instance [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'flavor' on Instance uuid c19065ba-2de8-4aa3-ba51-458dc5dd18b0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:54:49 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-0994dcc8-2c3c-48bd-a455-66965db6fa42 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:54:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:52 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:53 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:54:53 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:54:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:54:53 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:54:53 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:54:54 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Updating instance_info_cache with network_info: [{"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:54:54 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:54:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:54:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:54:54 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:54:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:54:55 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:54:57 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:00 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:55:05 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:55:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:55:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:55:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:55:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:55:10 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:12 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:15 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:17 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:20 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:55:30 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:55:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:55:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:55:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:55:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:55:35 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:35 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:55:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-9097e2b9-cb5c-4830-8cc5-49389578f1c2 req-75d7dc17-6be9-44b9-920c-5ad348b8d656 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received event network-changed-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG nova.compute.manager [req-9097e2b9-cb5c-4830-8cc5-49389578f1c2 req-75d7dc17-6be9-44b9-920c-5ad348b8d656 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Refreshing instance network info cache due to event network-changed-94b1f9ed-97f2-47b6-a547-86c7bda32221. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9097e2b9-cb5c-4830-8cc5-49389578f1c2 req-75d7dc17-6be9-44b9-920c-5ad348b8d656 service nova] Acquiring lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9097e2b9-cb5c-4830-8cc5-49389578f1c2 req-75d7dc17-6be9-44b9-920c-5ad348b8d656 service nova] Acquired lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG nova.network.neutron [req-9097e2b9-cb5c-4830-8cc5-49389578f1c2 req-75d7dc17-6be9-44b9-920c-5ad348b8d656 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Refreshing network info cache for port 94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:55:38 user nova-compute[82184]: INFO nova.compute.manager [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Terminating instance
Apr 12 02:55:38 user nova-compute[82184]: DEBUG nova.compute.manager [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:55:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.network.neutron [req-9097e2b9-cb5c-4830-8cc5-49389578f1c2 req-75d7dc17-6be9-44b9-920c-5ad348b8d656 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Updated VIF entry in instance network info cache for port 94b1f9ed-97f2-47b6-a547-86c7bda32221. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.network.neutron [req-9097e2b9-cb5c-4830-8cc5-49389578f1c2 req-75d7dc17-6be9-44b9-920c-5ad348b8d656 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Updating instance_info_cache with network_info: [{"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-9097e2b9-cb5c-4830-8cc5-49389578f1c2 req-75d7dc17-6be9-44b9-920c-5ad348b8d656 service nova] Releasing lock "refresh_cache-c19065ba-2de8-4aa3-ba51-458dc5dd18b0" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-a3c67a42-6e7a-443b-834e-c3a1aec73c82 req-706d3523-8215-4b04-bffa-cf5c18e5cd18 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received event network-vif-unplugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a3c67a42-6e7a-443b-834e-c3a1aec73c82 req-706d3523-8215-4b04-bffa-cf5c18e5cd18 service nova] Acquiring lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a3c67a42-6e7a-443b-834e-c3a1aec73c82 req-706d3523-8215-4b04-bffa-cf5c18e5cd18 service nova] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a3c67a42-6e7a-443b-834e-c3a1aec73c82 req-706d3523-8215-4b04-bffa-cf5c18e5cd18 service nova] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-a3c67a42-6e7a-443b-834e-c3a1aec73c82 req-706d3523-8215-4b04-bffa-cf5c18e5cd18 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] No waiting events found dispatching network-vif-unplugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.compute.manager [req-a3c67a42-6e7a-443b-834e-c3a1aec73c82 req-706d3523-8215-4b04-bffa-cf5c18e5cd18 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received event network-vif-unplugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:39 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Instance destroyed successfully.
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.objects.instance [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'resources' on Instance uuid c19065ba-2de8-4aa3-ba51-458dc5dd18b0 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:52:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-56434730',display_name='tempest-TestStampPattern-server-56434730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-56434730',id=47,image_ref='b0a853d4-2140-47ec-8d81-5ef1133ca1cb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpyzmcRX9rlNwf8L3npzKG+KhZsGBYg2FMRQESss2fLWTR7mB/j7XujY+I5ifJXOZVNKSQj7zwTGJjBzU1DUaSm2KRtc1OjWfWfBP++qIhir5IuETJWfPk9BYw0ygsoOw==',key_name='tempest-TestStampPattern-1893093837',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:52:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6594c28fbe004babb03de341f082b858',ramdisk_id='',reservation_id='r-0agzhawv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='91ef1049-cfc1-4ff7-bc79-f17897c49de1',image_min_disk='1',image_min_ram='0',image_owner_id='6594c28fbe004babb03de341f082b858',image_owner_project_name='tempest-TestStampPattern-1035046562',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1035046562-project-member',image_user_id='e5ed29e7a68045d1bf0b98f416adcb2f',owner_project_name='tempest-TestStampPattern-1035046562',owner_user_name='tempest-TestStampPattern-1035046562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:52:53Z,user_data=None,user_id='e5ed29e7a68045d1bf0b98f416adcb2f',uuid=c19065ba-2de8-4aa3-ba51-458dc5dd18b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converting VIF {"id": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "address": "fa:16:3e:86:4f:0c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94b1f9ed-97", "ovs_interfaceid": "94b1f9ed-97f2-47b6-a547-86c7bda32221", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:4f:0c,bridge_name='br-int',has_traffic_filtering=True,id=94b1f9ed-97f2-47b6-a547-86c7bda32221,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b1f9ed-97') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG os_vif [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:4f:0c,bridge_name='br-int',has_traffic_filtering=True,id=94b1f9ed-97f2-47b6-a547-86c7bda32221,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b1f9ed-97') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94b1f9ed-97, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:55:39 user nova-compute[82184]: INFO os_vif [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:4f:0c,bridge_name='br-int',has_traffic_filtering=True,id=94b1f9ed-97f2-47b6-a547-86c7bda32221,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94b1f9ed-97')
Apr 12 02:55:39 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Deleting instance files /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0_del
Apr 12 02:55:39 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Deletion of /opt/stack/data/nova/instances/c19065ba-2de8-4aa3-ba51-458dc5dd18b0_del complete
Apr 12 02:55:39 user nova-compute[82184]: INFO nova.compute.manager [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 02:55:39 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:55:39 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:55:40 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Took 0.43 seconds to deallocate network for instance.
Apr 12 02:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:55:40 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:55:40 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:55:40 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Deleted allocations for instance c19065ba-2de8-4aa3-ba51-458dc5dd18b0
Apr 12 02:55:40 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-959c1209-091f-45ad-ae1d-81bd0d5aad21 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.632s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:55:40 user nova-compute[82184]: DEBUG nova.compute.manager [req-f3ff44a1-81e3-406d-a13e-f0aabe19e51c req-66e82d3f-45f5-46dd-9663-5930f67651b5 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received event network-vif-deleted-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:55:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-696eed37-4608-446d-8bc9-f9b6d6d5716c req-ee67d5c8-03e7-4a6a-916f-7718b2e1dc63 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received event network-vif-plugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-696eed37-4608-446d-8bc9-f9b6d6d5716c req-ee67d5c8-03e7-4a6a-916f-7718b2e1dc63 service nova] Acquiring lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-696eed37-4608-446d-8bc9-f9b6d6d5716c req-ee67d5c8-03e7-4a6a-916f-7718b2e1dc63 service nova] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:55:41 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-696eed37-4608-446d-8bc9-f9b6d6d5716c req-ee67d5c8-03e7-4a6a-916f-7718b2e1dc63 service nova] Lock "c19065ba-2de8-4aa3-ba51-458dc5dd18b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:55:41 user nova-compute[82184]: DEBUG nova.compute.manager [req-696eed37-4608-446d-8bc9-f9b6d6d5716c req-ee67d5c8-03e7-4a6a-916f-7718b2e1dc63 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] No waiting events found dispatching network-vif-plugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:55:41 user nova-compute[82184]: WARNING nova.compute.manager [req-696eed37-4608-446d-8bc9-f9b6d6d5716c req-ee67d5c8-03e7-4a6a-916f-7718b2e1dc63 service nova] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Received unexpected event network-vif-plugged-94b1f9ed-97f2-47b6-a547-86c7bda32221 for instance with vm_state deleted and task_state None.
Apr 12 02:55:41 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:55:44 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:44 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:55:44 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:55:44 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:55:44 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.processutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82184) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 02:55:45 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:55:45 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:55:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8742MB free_disk=26.07782745361328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82184) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:55:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:55:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:55:49 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:55:54 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681268139.4785202, c19065ba-2de8-4aa3-ba51-458dc5dd18b0 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:55:54 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] VM Stopped (Lifecycle Event)
Apr 12 02:55:54 user nova-compute[82184]: DEBUG nova.compute.manager [None req-4156a02b-2243-4b2d-9be6-2f835a749527 None None] [instance: c19065ba-2de8-4aa3-ba51-458dc5dd18b0] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:55:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:55:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:55:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:55:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:55:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:55:54 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:55:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:55:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:55:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:55:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:55:55 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquired lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:55:55 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Forcefully refreshing network info cache for instance {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 02:55:55 user nova-compute[82184]: DEBUG nova.objects.instance [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lazy-loading 'info_cache' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:55:56 user nova-compute[82184]: DEBUG nova.network.neutron [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating instance_info_cache with network_info: [{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:55:56 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Releasing lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:55:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updated the network info_cache for instance {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 02:55:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:55:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:55:59 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:01 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:56:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:56:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:56:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:56:04 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:56:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:56:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:56:09 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:14 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:19 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:24 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:56:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:56:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:56:29 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-bfe9a358-fe30-4a80-b44b-2f5129646809 req-c8eddef4-9a5d-43d7-8cf4-33e8af02bde8 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received event network-changed-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-bfe9a358-fe30-4a80-b44b-2f5129646809 req-c8eddef4-9a5d-43d7-8cf4-33e8af02bde8 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Refreshing instance network info cache due to event network-changed-55871f74-ac4f-4e6f-86cb-5f593dd8de7d. {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bfe9a358-fe30-4a80-b44b-2f5129646809 req-c8eddef4-9a5d-43d7-8cf4-33e8af02bde8 service nova] Acquiring lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bfe9a358-fe30-4a80-b44b-2f5129646809 req-c8eddef4-9a5d-43d7-8cf4-33e8af02bde8 service nova] Acquired lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG nova.network.neutron [req-bfe9a358-fe30-4a80-b44b-2f5129646809 req-c8eddef4-9a5d-43d7-8cf4-33e8af02bde8 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Refreshing network info cache for port 55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:56:32 user nova-compute[82184]: INFO nova.compute.manager [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Terminating instance
Apr 12 02:56:32 user nova-compute[82184]: DEBUG nova.compute.manager [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Start destroying the instance on the hypervisor. {{(pid=82184) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-e41673f6-2440-4d19-9969-4922de98ef84 req-69bc9938-edee-4fcc-ae8c-82e6b929e912 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received event network-vif-unplugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e41673f6-2440-4d19-9969-4922de98ef84 req-69bc9938-edee-4fcc-ae8c-82e6b929e912 service nova] Acquiring lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e41673f6-2440-4d19-9969-4922de98ef84 req-69bc9938-edee-4fcc-ae8c-82e6b929e912 service nova] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-e41673f6-2440-4d19-9969-4922de98ef84 req-69bc9938-edee-4fcc-ae8c-82e6b929e912 service nova] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-e41673f6-2440-4d19-9969-4922de98ef84 req-69bc9938-edee-4fcc-ae8c-82e6b929e912 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] No waiting events found dispatching network-vif-unplugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG nova.compute.manager [req-e41673f6-2440-4d19-9969-4922de98ef84 req-69bc9938-edee-4fcc-ae8c-82e6b929e912 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received event network-vif-unplugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d for instance with task_state deleting. {{(pid=82184) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG nova.network.neutron [req-bfe9a358-fe30-4a80-b44b-2f5129646809 req-c8eddef4-9a5d-43d7-8cf4-33e8af02bde8 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updated VIF entry in instance network info cache for port 55871f74-ac4f-4e6f-86cb-5f593dd8de7d. {{(pid=82184) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG nova.network.neutron [req-bfe9a358-fe30-4a80-b44b-2f5129646809 req-c8eddef4-9a5d-43d7-8cf4-33e8af02bde8 service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating instance_info_cache with network_info: [{"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:56:32 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-bfe9a358-fe30-4a80-b44b-2f5129646809 req-c8eddef4-9a5d-43d7-8cf4-33e8af02bde8 service nova] Releasing lock "refresh_cache-91ef1049-cfc1-4ff7-bc79-f17897c49de1" {{(pid=82184) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 02:56:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [-] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Instance destroyed successfully.
Apr 12 02:56:33 user nova-compute[82184]: DEBUG nova.objects.instance [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lazy-loading 'resources' on Instance uuid 91ef1049-cfc1-4ff7-bc79-f17897c49de1 {{(pid=82184) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG nova.virt.libvirt.vif [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T02:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-375589421',display_name='tempest-TestStampPattern-server-375589421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-375589421',id=46,image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpyzmcRX9rlNwf8L3npzKG+KhZsGBYg2FMRQESss2fLWTR7mB/j7XujY+I5ifJXOZVNKSQj7zwTGJjBzU1DUaSm2KRtc1OjWfWfBP++qIhir5IuETJWfPk9BYw0ygsoOw==',key_name='tempest-TestStampPattern-1893093837',keypairs=<?>,launch_index=0,launched_at=2023-04-12T02:49:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6594c28fbe004babb03de341f082b858',ramdisk_id='',reservation_id='r-4s30shzb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='16f93c82-82f4-4843-b632-b6b6fe0b6c16',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1035046562',owner_user_name='tempest-TestStampPattern-1035046562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T02:52:44Z,user_data=None,user_id='e5ed29e7a68045d1bf0b98f416adcb2f',uuid=91ef1049-cfc1-4ff7-bc79-f17897c49de1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converting VIF {"id": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "address": "fa:16:3e:7c:55:4c", "network": {"id": "ee480d6c-5126-42d8-ac77-8c6afc6a1248", "bridge": "br-int", "label": "tempest-TestStampPattern-1676245761-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6594c28fbe004babb03de341f082b858", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55871f74-ac", "ovs_interfaceid": "55871f74-ac4f-4e6f-86cb-5f593dd8de7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG nova.network.os_vif_util [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=55871f74-ac4f-4e6f-86cb-5f593dd8de7d,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55871f74-ac') {{(pid=82184) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG os_vif [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=55871f74-ac4f-4e6f-86cb-5f593dd8de7d,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55871f74-ac') {{(pid=82184) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55871f74-ac, bridge=br-int, if_exists=True) {{(pid=82184) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:33 user nova-compute[82184]: INFO os_vif [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:55:4c,bridge_name='br-int',has_traffic_filtering=True,id=55871f74-ac4f-4e6f-86cb-5f593dd8de7d,network=Network(ee480d6c-5126-42d8-ac77-8c6afc6a1248),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55871f74-ac')
Apr 12 02:56:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Deleting instance files /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1_del
Apr 12 02:56:33 user nova-compute[82184]: INFO nova.virt.libvirt.driver [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Deletion of /opt/stack/data/nova/instances/91ef1049-cfc1-4ff7-bc79-f17897c49de1_del complete
Apr 12 02:56:33 user nova-compute[82184]: INFO nova.compute.manager [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 12 02:56:33 user nova-compute[82184]: DEBUG oslo.service.loopingcall [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82184) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG nova.compute.manager [-] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Deallocating network for instance {{(pid=82184) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] deallocate_for_instance() {{(pid=82184) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG nova.network.neutron [-] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Updating instance_info_cache with network_info: [] {{(pid=82184) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 02:56:33 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Took 0.42 seconds to deallocate network for instance.
Apr 12 02:56:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:56:33 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:56:33 user nova-compute[82184]: INFO nova.scheduler.client.report [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Deleted allocations for instance 91ef1049-cfc1-4ff7-bc79-f17897c49de1
Apr 12 02:56:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-6827543e-cd87-403e-ba66-2c8d1bc07db8 tempest-TestStampPattern-1035046562 tempest-TestStampPattern-1035046562-project-member] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.644s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:56:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-59f2fc07-34f9-462c-a0cf-227db3dd6582 req-d88a3876-8110-4ffb-85f8-aeba5bc6011d service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received event network-vif-deleted-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:56:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-a842579d-59c2-42cb-a23b-e08221efda82 req-a48fdc50-9ac0-48d7-bc63-4be030c58a9b service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received event network-vif-plugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 02:56:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a842579d-59c2-42cb-a23b-e08221efda82 req-a48fdc50-9ac0-48d7-bc63-4be030c58a9b service nova] Acquiring lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:56:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a842579d-59c2-42cb-a23b-e08221efda82 req-a48fdc50-9ac0-48d7-bc63-4be030c58a9b service nova] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:56:34 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [req-a842579d-59c2-42cb-a23b-e08221efda82 req-a48fdc50-9ac0-48d7-bc63-4be030c58a9b service nova] Lock "91ef1049-cfc1-4ff7-bc79-f17897c49de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:56:34 user nova-compute[82184]: DEBUG nova.compute.manager [req-a842579d-59c2-42cb-a23b-e08221efda82 req-a48fdc50-9ac0-48d7-bc63-4be030c58a9b service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] No waiting events found dispatching network-vif-plugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d {{(pid=82184) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 02:56:34 user nova-compute[82184]: WARNING nova.compute.manager [req-a842579d-59c2-42cb-a23b-e08221efda82 req-a48fdc50-9ac0-48d7-bc63-4be030c58a9b service nova] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Received unexpected event network-vif-plugged-55871f74-ac4f-4e6f-86cb-5f593dd8de7d for instance with vm_state deleted and task_state None.
Apr 12 02:56:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:56:36 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:56:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:42 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:56:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:43 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:56:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 02:56:43 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] There are 0 instances to clean {{(pid=82184) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 02:56:45 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:56:45 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:56:45 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:56:46 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:56:46 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:56:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=26.16873550415039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:56:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:56:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:56:46 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:56:46 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:56:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:56:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:56:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:56:47 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:56:48 user nova-compute[82184]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681268193.1876092, 91ef1049-cfc1-4ff7-bc79-f17897c49de1 => Stopped> {{(pid=82184) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 02:56:48 user nova-compute[82184]: INFO nova.compute.manager [-] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] VM Stopped (Lifecycle Event)
Apr 12 02:56:48 user nova-compute[82184]: DEBUG nova.compute.manager [None req-abb2febd-7bce-4ba2-98c5-c375050c5684 None None] [instance: 91ef1049-cfc1-4ff7-bc79-f17897c49de1] Checking state {{(pid=82184) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 02:56:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:56:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:56:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:56:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:56:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:55 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:56:55 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82184) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 02:56:56 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:56:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Starting heal instance info cache {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 02:56:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Rebuilding the list of instances to heal {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 02:56:56 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Didn't find any instances for network info cache update. {{(pid=82184) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 02:56:58 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:56:58 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:02 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:57:03 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:08 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:57:13 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:57:17 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:17 user nova-compute[82184]: DEBUG nova.compute.manager [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Cleaning up deleted instances with incomplete migration  {{(pid=82184) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 02:57:18 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:57:23 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:57:25 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:28 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:31 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:33 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:37 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:38 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:57:38 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:57:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:57:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:57:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:57:43 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:44 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:46 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager.update_available_resource {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:57:46 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:57:46 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Auditing locally available compute resources for user (node: user) {{(pid=82184) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 02:57:47 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:57:47 user nova-compute[82184]: WARNING nova.virt.libvirt.driver [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=26.1673583984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82184) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82184) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing inventories for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating ProviderTree inventory for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Updating inventory in ProviderTree for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing aggregate associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, aggregates: None {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Refreshing trait associations for resource provider ab0d5e15-c70b-4898-ad6b-82542f647a5e, traits: COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=82184) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.compute.provider_tree [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed in ProviderTree for provider: ab0d5e15-c70b-4898-ad6b-82542f647a5e {{(pid=82184) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.scheduler.client.report [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Inventory has not changed for provider ab0d5e15-c70b-4898-ad6b-82542f647a5e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82184) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG nova.compute.resource_tracker [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Compute_service record updated for user:user {{(pid=82184) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 02:57:47 user nova-compute[82184]: DEBUG oslo_concurrency.lockutils [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=82184) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 02:57:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 02:57:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82184) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 02:57:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:57:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82184) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 02:57:48 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 02:57:49 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:51 user nova-compute[82184]: DEBUG oslo_service.periodic_task [None req-81cd88f1-2442-4554-bdce-c8dcda146d32 None None] Running periodic task ComputeManager._sync_power_states {{(pid=82184) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 02:57:53 user nova-compute[82184]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82184) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}